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ABSTRACT 

This document contains summaries of 48 research 
projects that were, with few exceptions, funded under Section 353 of 
the Adult Education Act. Discussed in the introduction are the 
distribution and stated purposes of Section 353 grants, the 
procedures used to locate the project reports suomarized, criteria 
used to determine which projects would be profiled, and information 
about retrieving the copies of the project reports. The 48 summaries 
are grouped under the following section headings: assessment and 
testing (10 projects); curriculum and instruction (15 projects); 
participation and retention (9 projects); and surveys and evaluations 
(14 projects). Each project summary contains some or all of the 
following: ERIC Document (ED) and/or project number, date, state, 
contractor, purpose, procedure, summary of findings, comments, 
correlations/cross-references, contact information, and source from 
which copies of the full report and follow-up technical papers (if 
available) may be obtained. (MN) 
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introduction 



Section 353 of the Adult Education Act (Public Law 100-297) pro- 
vides federal funds to states to be used for Special Demonstration 
Projects and Teacher Training. Most of Section 353's demonstration 
(or pilot) projects have delivered direct student services, and its teacher- 
training projects have provided staff development materials and train- 
ing workshops. 

A handful of projects, however, have used Section 353 funds for re- 
search, both quantitative and qualitative in nature, and for demonstra- 
tion projects with an experimental design. The purpose of Research 
Distilled was to take a look at Section 353 projects of all types that 
employed an experimental design. What was being done between 1989 
and 1993? How were these research projects designed? Of most impor- 
tance, what new information have these studies produced? 



Research under 353 

A classic model of a research project 
supported by Adult Education Act spe- 
cial-projects funds is "Ethnographic Re- 
search on Word Recognition Strategies 
of Aclult Beginning Readers" (Boraks & 
Schumacher, 1981). Granted through 
the Virginia State Department of Edu- 
cation to Virginia Commonwealth Uni- 
versity, this serious academic study pro- 
duced findings on adult beginning read- 
ers that have been widely cited and in- 
tegrated into literacy curricula in Vir- 
ginia and beyond. 

Another, less academic, early ex- 
ample is "A Comparison of Community 
Linkage and Outreach Models for Maxi- 
mizing Adult Basic Education," di- 
rected by Michael A. Ciavarella at 
Shippensburg State College (now Ship- 
pensburg University) in Pennsylvania. 
Though it did not compare a control 
group with an experimental group, or 
compare anything to baseline data, that 
study did survey ABE programs to com- 
pare the ways in which they were inter- 
acting with the general public. 

In fact, experimental design of dem- 
onstration projects is implicit in the 
Adult Education Act. The Federal Reg- 
ister of October 28, 1991, describes the 
State plan required for submission by 
each State Education Agency (SEA) ap- 
plying for an Adult Education Act grant. 
That is, the National Literacy Act of 
1991 (P.L. 102-73) amended Section 353 
urease to not less than 15% of each 
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state's grant the amount to be spent for 
"special experimental demonstration 
projects and teacher training projects." 
Although each state may establish its 
own criteria and priorities for adminis- 
tering special projects, and two-thirds of 
the 15% must be reserved for training 
staff, the word experimental in refer- 
ence to demonstration projects encour- 
ages the use of research methodology. 

In Pennsylvania, the. Bureau of Adult 
Basic and Literacy Education's funding 
guidelines have grown much more spe- 
cific with regard to research. For 
FY 1995, research— on curricula, deliv- 
ery systems, techniques or processes, 
and data reporting — represents four of 
the state's eight funding priorities for 
demonstration projects. This emphasis 
provides the opportunity to study a situ- 
ation or population related to adult ba- 
sic and literacy education or to test new 
program ideas through demonstration 
projects using established research de- 
sign principles. 

A Source Book for Evaluating Special 
Projects (198X) suggests that 353 dem- 
onstration piojects be "controlled stud- 
ies using random assignment or quasi- 
experimental designs." Other methods 
include pre-post outcome measures, fol- 
low-up investigations, and analysis of 
data across demonstration sites. The 
authors cite the limitations of conduct- 
ing pre- and post-testing within only 
one group; instead, they recommend the 
use of the noncquivalcnt control 
method, which employs comparison 



groups of students who arc or arc not 
using the project's program design. At 
the very least, group performance can 
be compared to norms instead of to a 
comparison group, if norms arc avail- 
able. The purpose of demonstration 
projects, says the report, is to demon- 
strate whether or not it is worthy of rep- 
lication elsewhere. This determination 
can be made only thro lgh project de- 
signs based on objectives that will pro- 
vide a comparison against which suc- 
cess can be measured. 



Practitioner as Researcher 

In several states, Section 353 is also 
increasingly supporting field-based 
practitioner action research as one staff 
development activity. A project called 
Study of ABE/ESL Instructor Training 
Approaches (1991, sec page 30) identi- 
fies such ethnographic studies as "an ef- 
fective staff development technique. 
Through action research, teachers iden- 
tify the questions that interest them 
and plan for and conduct systematic in- 
quiry in their own teaching environ- 
ments as they work with their students 
... The information and insights gath- 
ered through this process are used by 
teacher-researchers to improve their 
own practice and/or to share with oth- 
ers." 

The Statewide Adult Basic Education 
System (SABES) in Massachusetts fol- 
lows a systematic six-step process for 
organizing action research projects: 

1. Learn how to look at the class- 
room. Keep a journal or discuss issues 
with other practitioners to identify rc- 
scarchable problems and explore pos- 
sible interventions. 

2. Form a research question. It 
should be interesting, focused, and fi- 
nite enough to be answered within the 
constraints of the practitioner's time 
and resources. 

3. Create a research design. Utilize 
quantitative and/or qualitative methods. 

4. Collect data. Collection methods 
include keeping records, surveying pub- 
lished research, collecting students' 
writing, and administering tests. 

5. Analyze data. This could be in the 
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form of a summary, graph, or chart. 

6. Share results. This might be infor- 
mally, with students or other teachers, 
or formally, in a report or a presentation 
at staff development workshops. 

Quigley (1994) summarizes that "Ac- 
tion research ... has four distinct steps: 
1) Plan, 2) Act, 3) Observe, 4) Reflect." 
This cycle can then be repeated "to test 
new insights and systematically ob- 
serve and document how each new in- 
sight affects our practice." 

A similar procedure may be followed 
by a "study circle," in which teachers 
collaborate to conduct the action re- 
search and meet regularly to share dis- 
coveries and techniques and discuss 
ways to improve both their teaching 
practice and their staff development 
program. 

The Virginia Adult Educators Re- 
search Network, which is funded under 
Section 353, provides a system for coor- 
dinating action research. In 1993, 
Suzanne Cockley of the Network pro- 
duced The Adult Educator's Guide to 
Practitioner Research, which follows 
essentially the Massachusetts model, as 
described above. Cockley assists inter- 
ested practitioners in planning action 
research and coordinating their work. A 
profile of the Network's The Year in Re- 
view, Volume 2: 1992-1993, summa- 
rizes that year's action research projects 
on page 19 of this publication. 



Locating the Projects 

Research Distilled: Summaries of 
Adult Education Act, Section 353 Re- 
search Projects, 1989-93 set out to col- 



lect and read reports of all types of re- 
search projects conducted under Section 
353 grants, summarize the findings, and 
compile them into a publication. We 
began under the assumption that we 
would merely request lists, presumably 
including abstracts, of all 1989-93 Sec- 
tion 353 projects from the U.S. Depart- 
ment of Education, Division of Adult 
Education and Literacy (DAEL) Clear- 
inghouse, then review final reports of 
those projects that utilized an experi- 
mental design. 

However, the project evolved into a 
test of the 353 dissemination system as 
much as a review of the projects them- 
selves. We discovered that the U.S. De- 
partment of Education's most compre- 
hensive publication listing 353 projects 
is the DAEL Clearinghouse's A Guide 
to Special Demonstration and Teacher 
Training Projects: Special Answers for 
Special Needs (July 1993), which is 
billed as a compilation of "exemplary" 
projects. Through various research 
means, it became apparent that no com- 
prehensive listing of all projects funded 
under Section 353 currently exists. 

This realization necessitated a much 
wider search than anticipated. We pro- 
ceeded to contact each State Literacy 
Resource Center directly to obtain lists 
state by state. For about half the states, 
we had to contact State Adult Educa- 
tion Directors rather than Literacy Re- 
source Center Directors because many 
of the resource centers were just being 
formed. Therefore, it is possible that our 
correspondence never reached the ap- 
propriate person. After a second contact 
(three for Florida and Texas), we rc- 
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The ERIC Clearinghouse on Adult, 
Career, and Vocational Education 
The Center on Education and Training 
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202-205-9289 
Fax: 202-205-8973 

PA State Literacy Resource Centers 
AdvancE: 
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ceived responses from only 13 states: 
Alabama, Arizona, Florida, Iowa, Ken- 
tucky, Massachusetts, Montana, North 
Carolina, Ohio, Oregon, Pennsylvania, 
Tennessee, and West Virginia. Several of 
those states courteously responded de- 
spite having produced no research 
projects. Some states indicated that 
they do not have, or were unable to lo- 
cate, central listings of funded 353 
projects. A few states were able to sup- 
ply abstracts of only the current or the 
past two years' projects. 

Based on the state listings we did re- 
ceive, wc requested copies of final re- 
ports of every project that appeared to 
have a research orientation. There was 
no central source for these reports: some 
came from DAEL, some from ERIC, 
some from individual states, and some 
from project contractors. All of the 
Pennsylvania 353 reports were readily 
available from our State Literacy Re- 
source Centers, and all projects were 
conveniently classified by type, such as 
"Research." 

.Wc also located several Section 353 
demonstration projects of a research na- 
ture in the DAEL Clearinghouse's Re- 
source Update that were not classified 
as such. In light of possible cross-classi- 
fication, wc pored through lists of all 
project descriptions in those bulletins 
and, in the absence of any classification 
at all, every state list we received, to try 
to discern from sketchy abstracts and 
sometimes only titles whether a project 
was in any way research based. This 
subjective search may have overlooked 
some projects that should have been in- 
cluded. 

Another reason some research pro- 
jects may not be profiled in this publi- 
cation is that some final reports from 
1 989-93 that wc requested were already 
out of print or reported by their listed 
sources to be "unavailable," or our re- 
quest for a final report was not fulfilled. 
Conversely, some FY1 993 projects were 
too recent to have yet entered the docu- 
ment stream. 

In summary, wc located research 
projects conducted under Section 353 of 
the Adult Education Act through the 
following means: 1) publications pro- 
duced by Pennsylvania's State Literacy 
Resource Centers,- 2) several ERIC list- 
ings or other references to ERIC docu- 
ment numbers; 3) A Guide to Special 
Demonstration and Teacher Training 
Projects: Special Answers for Special 
Needs, from the DAEL Clearinghouse,- 
4) at least two contacts to every state 
literacy resource center; and 5) corrc- 



spondcncc directly to individual con- 
tracting agencies. We maximized use of 
one of our own State Literacy Resource 
Centers, as Cheryl Harmon of AdvancJE^ 
fulfilled our numerous, scattered re- 
quests for original documents and ERIC 
microfiche. Overall, our search was con- 
scientious but, of necessity, far from 
systematic. 

The result is that this publication is 
not exhaustive,- rather, it is a collection 
drawn only from those projects we were 
able to locate. Our inability to locate 
projects and secure final reports con- 
notes that others would likely experi- 
ence difficulty as well. 

Also included here are three projects 
funded under Section 383 of the Adult 
Education Act — ''evaluation projects" 
funded directly by the U.S. Department 
of Education through the Research In- 
formation Network. 



Typical of reports we excluded is that 
of a 1993 project which reported gains 
in reading and math scores of adult stu- 
^denf^^enrolled in a five-county com- 
puter-based program without any com- 
parison to scores achieved through a tra- 
ditional delivery system, because a con- 
trol group did not exist. Demonstration 
projects such as this that produced no 
comparative data — and they arc numer- 
ous — did not meet our criteria of a re- 
search project. 

Also, our search noted a number of 
similar projects done in several states, 
suggesting that grantees either did not 
(or could not) search the literature (as is 
requested in proposal-writing guide- 
lines) or could have replicated, vali- 
dated, or adapted another project design 
rather than duplicate efforts by pursu- 
ing the same basic objective from the 
ground up. 



Reading the Reports 

Some of the reports we received were 
clearly formatted according to standard 
research-reporting protocol. Some, even 
if designed as research projects, did not 
follow standard research procedure; 
sometimes, project objectives strayed 
from the central purpose. From even 
some well-written reports, it was im- 
possible to discern whether procedures 
were clearly planned and carried out or 
whether the premise itself was sound. 
However, from some reports, method- 
ological flaws were obvious, and in sev- 
eral reports, the writer was candid in 
pointing out the study's weaknesses. 

The following objective and subjec- 
tive criteria determined those projects 
to be profiled for this publication: 

1 . The project was funded under the 
Adult Education Act, Section 353 or 
Section 383, between FY1989 and 
FY 1993. 

The project's final report could be 
located and reviewed firsthand. 

3. The project had some son of ex- 
perimental design: a controlled study, 
collection and analysis of data, evalua- 
tion based on set criteria, etc. Only first- 
hand research projects were included, 
not those which aimed solely to survey 
the literature on a particular topic. 

4. The project's findings were 
Jcemed worthy of reporting for any rea- 
son: they were exemplary, had broad- 
based applicability, could be validated 
or replicated, or had an unfulfilled or un- 
developed premise which other re- 
searchers might be able to refine and 

lop in related future studies. 
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Document Retrieval 

Each project profiled here lists an ad- 
dress for readers wishing to sec a full fi- 
nal report. "Contact information" in 
the profiles refers to project producers, 
not document sources. DAEL Clearing- 
house, ERIC, and Pennsylvania State 
Litcracv Resource Center addresses and 
phone numbers are provided at right. As 
you proceed in securing copies, please 
keep in mind the following points: 

• Check for availability with your 
State Literacy Resource Center first. 

• If sources receive numerous requests, 
a recovery fee may be charged to supply 
the document. (Oregon, for cxairplc, 
charg- s fees of $3.50 to $37 for copies of 
353 projects.) 

• ERIC documents arc generally avail- 
able on microfiche through State Lit- 
eracy Resource Centers. If you wish to 
purchase hard copies or mi crof iche , use 
the ERIC Document Reproduction Ser- 
vice (contact information at right). 

• Pennsylvania project numbers are 
state-specific,- any reports that are also 
DAEL or ERIC documents carry a sepa- 
rate number. Projects from states other 
than Pennsylvania listed no state 
project numbers. 

• The reliability of retrieval sources is 
not guaranteed. Readers arc "on their 
own" to further pursue the projects 
listed here. 

Despite the retrieval problems we 
encountered, improvements in the dis- 
semination system appear to be in 
progress. The National Institute for Lit- 
eracy, funded under the National Lit- 
eracy Act of 1991, has a work group on 

( 
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National Literacy Data Base Informa- 
tion Requirements, whose task is to 
link existing national literacy-related 
databases and State Literacy Resource 
Centers to form single-point-of-contact 
access to all national sources. 

One more note: This publication was 
written by a "nonacademic" with the 
aim of describing projects in "plain 
English." Nevertheless, because of the 
nature of the subject matter and the re- 
ality that it will be of greatest interest 
to researchers, it was considered appro- 
priate to employ a certain level of aca- 
demic terminology, particularly in re- 
flection of the style of the reports. 

Herewith, then, are profiles of the 47 
Adult Education Act research projects 
located and summarized for this project. 
Projects are divided into four sections 
of related subject matter — Assessment 
and Testing, Curriculum and Instruc- 
tion, Participation and Retention, and 
Surveys and Evaluations. Within each 
section, the profiles arc sequenced by 
date and alphabetized within fiscal year. 
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Section One 

Assessment and Testing 



Determining Reading Levels for Nonnative 
Speakers of English: A Study to Explore 
the Possibility of Correlations Between 
Nonnative Literacy (ESL) and Adult Basic 
Education (ABE) Reading Tests 

Project #ED3 18289 
Date: 1989 
State: Illinois 

Contractor: William Raincy Harper 

College, Palatine, IL 
Purpose: In response to employers' in- 
terest in measuring adult ESL achieve- 
ment, particularly reading comprehen- 
sion; in grade-level equivalents, this 
project sought to determine whether 
there is any correlation between com- 
monly used ESL tests of reading com- 
prehension and ABE norm-referenced 
tests and, if so, to determine which tests 
arc more highly correlated and whether 
any adult ESL reading comprehension 
tcsi could be used to predict perfor- 
mance on ABE tests. 
Procedure: The first phase of the project 
was to conduct a telephone survey of 
testing instruments being used in adult 
education programs in Illinois. The ini- 
tial phone survey discovered that 39 
ESL and 43 ABE-GED tests were in use 
in Illinois; 19 tests were being used for 
ESL placement and 12 for achievement 
while 17 tests were being used for ABE 
placement and 14 for achievement. 
Among ABE tests, the TABE was used 
by 60% of programs, with the ABLE a 
distant second. These two tests were 
selected as the ABE instruments for the 
study. Several ESL instruments were 
eliminated from the study for various 
reasons. The English Language Skills 
Assessment (ELSA) was selected for the 
study because it was widely used; how- 
ever, it was out of print, so the Test for 
English Proficiency Level (TEPL) was 
added as the second ESL instrument, al- 
though it was not being used in Illinois 
at the time. 

Subjects were solicited from the Col- 
lege of Lake County, Elgin Community 
College, Oakton Community College, 
William Raincy Harper College, and the 
ESL program of Township High School. 
Eighteen teachers were trained to ad- 
q minister the tests, and combinations of 
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four tests were administered to 897 stu- 
dents by March. The sample was 53% 
Mexican, 9% Japanese, 5% Korean, 4% 
Polish, 3% Salvadoran, and numerous 
other groups represented by 1% or 2% 
of the sample. 

Summary of findings: Some specific cor- 
relations between ESL and ABE tests 
were found: a range of .784 between the 
TEPL and the TABE-M and .644 be- 
tween the ESLA I and ABLE-1. 

The researchers recommended a new 
series of testing be conducted using only 
the TEPL-TABE-M and ESLA-IN and 
ABLE-1 comparisons, in order to in- 
crease the sample size for these tests 
that produced the highest correlations 
so that regression tables could be con- 
structed. 

Comments: The final report contains 
numerous statistical tables charting 
data on the samples as well as test re- 
sults and correlations. These would 
serve as excellent models for anyone 
conducting a similar study. 
Contact information: 

Patricia Mulcronc 

Associate Professor/Chair 

Adult Educational Development 

William Raincy Harper College 

1200 W. Algonquin Rd. 

Palatine, IL 60067-7498 
For copy of full report: 

ERIC 



Identifying Valid Measures of Reading, 
Mathematics and Writing for Workplace 
Environments 

PA Project #98-9040 

Date: 1989 

State: Pennsylvania 

Contractor: University of Pittsburgh, 

Pittsburgh, PA 
Purpose: To develop a screening instru- 
ment, to be called ALERT (Adult Lit- 
eracy Employment-Related Tasks), 
based on realistic workplace-oriented 
reading, mathematics, and writing tasks 
suitable for use with adults in work- 
place education programs. 
Procedure: Initially, the project devel- 
oped appropriate reading, writing, and 
math prompts. Four expository reading 
passages were selected and rewritten to 



a fourth-grade level. Based on these pas- 
sages, tests were prepared using both 
oral-reading and maze formats. For the 
writing prompt, it was determined that 
adults would be asked to write descrip- 
tions of their jobs. Math prompts con- 
sisted of 60 single- and double-digit ba- 
sic math problems, also at a fourth- 
grade level. Field testing confirmed that 
the maze procedure was an adequate 
screening method and more efficient 
than oral reading. 

During the next phase, the test in- 
strument was field-tested on 53 sub- 
jects: six University secretaries, 23 stu- 
dents in the University's adult literacy 
program, and 14 graduate students. 

The California Achievement Test, 
Level 18, was used for validating scores 
against the ALERT instrument. Both 
tests were administered to a validity 
group of 98 volunteer adult students re- 
cruited from Pittsburgh-area adult lit- 
eracy programs. The ALERT only was 
administered to a normative group of 
603 adults. Cut-off levels were deter- 
mined to identify individuals who 
would possibly or definitely benefit 
from additional diagnosis or need lit- 
eracy instruction. 

Summary of findings: "Based on the 
validation data, ALERT appears to be an 
approach that can be used for initial 
screening and identification, particu- 
larly in the areas of reading and math- 
ematics/' 

Comments: The developers stressed 
that ALERT should be viewed as an ap- 
proach to assessment, that is that any 
company could produce its own specific 
curriculum-based measure along the 
same lines. 

Correlations/cross-references: Correla- 
tions between the ALERT Reading Sec- 
tion and the Vocabulary Subtest of the 
California Achievement Test, as well as 
between the ALERT Mathematics Sec- 
tion and the Mathematics Computation 
Subtest of the California Achievement 
Test, were high, indicating "that 
ALERT tends to identify the same indi- 
viduals requiring further help as well as 
those who do not need assistance/' Cor- 
relation between the ALERT writing 
fluency test and the Written Expression 
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Subtest of the California Achievement 
Test were significant but not high. This 
suggested that the writing section 
should "be interpreted in a more gen- 
eral, informal manner." 
Contact information: 

Drs. Meryl K. Lazar and Rita M. Bean 

University of Pittsburgh 

Institute for Practice and Research in 

Education 

ST23 Forbes Quadrangle 

Pittsburgh, PA 15260 

412-648-7210 
For copy of full report and follow-up 
technical paper: 

PA State Literacy Resource Centers 

For complete copy of the ALERT in- 
strument, contact the University of 
Pittsburgh address above. Enclose $4.00 
to cover copying and mailing. 



Iowa's Norming Study of the Tests of 
General Educational Development 

ERIC #ED3 14474 
Date: 1989 
State: Iowa 

Contractor: Iowa State Department of 

Education, Dcs Moines, IA 
Purpose: Because Iowa offers a state 
high school equivalency diploma to 
GED graduates who achieve a certain 
minimum score, it is imperative to that 
state's Department of Education that 
the two types of diplomas be as aca- 
demically equivalent as possible. 1 here- 
fore, when the revised 1988 GED was 
released, this study was conducted to 
determine how well graduating higl: 
school seniors performed on the new 
edition, providing data to describe and 
evaluate the score reference for GED 
candidates in terms of the percentage of 
high school graduates a GED candidate 
must exceed to obtain the Iowa equiva- 
lency diploma. Also, the study was done 
to evaluate and potentially review the 
minimum score requirement for the 
Iowa equivalency diploma. 
Procedure: Between June 1, 1988 and 
June 1, 1989, all five of the revised 1988 
GED Tests were administered to a na- 
tional sample of 1,278 graduating high 
school seniors and 722 Iowa graduating 
high school seniors. Their scores were 
compared to those of 15,496 national 
GED graduates and 3,455 Iowa GED 
graduates. 

Summary of findings: Pass rates on the 
GED Tests were higher for the GED 
candidates than for traditional high 
school giaduates. This was attributed to 
a direct result of instructional programs 
offered to prepare for the GED through 
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Iowa's community colleges. 

Consequently, Iowa raised its mini- 
mum/maximum score standard of 35/ 
45 to 40/45 without significant negative 
impact on the GED candidate popula- 
tion. This would satisfy requirement for 
a 70-72% pass rate among the norm 
group of high school seniors which re- 
quirement the state had set up. 
Comments: It is notable that one state's 
norming study (though it included a na- 
tional sample as well) would produce 
higher pass rates for GED candidates 
than graduating high school seniors. If 
this result were achieved in other states, 
it would hold the potential for greater 
credibility for the GED ccr ificate and 
perhaps warrant the issuance of equiva- 
lency diplomas in more states. 
Correlations/cross-references: The final 
report correlates this study to Iowa's 
GED Candidate Impact Study, which 
determined the impact of different lev- 
els for minimum score requirements on 
the passing rate for GED graduates and 
candidates as a whole and the impact of 
different passing scores of subgroups of 
GED candidates. That study was not ex- 
amined for this publication. 
Contact information: 
Dr. John Hartwig 
Division of Community Colleges 
Iowa Department of Education 
Grimes State Office Building 
Des Moines, IA 50319-0146 
515-281-3636 
For copy of full report: 
ERIC • 



Assessment and Adult Education: The Iowa 
Model 

ERIC #ED321028 
Date: 1990 
State: Iowa 

Contractor: Iowa State Department of 

Education, Dcs Moines, IA 
Purpose: To document the qualities of 
excellence, accountability, and purpose 
that arc present in Iowa's adult basic 
education population. 
Procedure: The study employed a six- 
step process: create a task force; submit 
written assessment reports from ABE 
coordinators; develop, disseminate, and 
repon major assessment outcomes 
cross-re ( crcnccd by target populations 
and practices; identify major assess- 
ment procedures, practices, and out- 
comes prevalent across major popula- 
tion categories; record additional assess- 
ment procedures or practices; and de- 
velop a model that can he replicated for 
national use. 
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Summary of findings: The report sum- 
marized the findings as follows: 

1. All ABE programs in Iowa use 
comprehensive assessment procedures 
or practices. 

2. Six major target populations arc 
served by the ABE program in Iowa. 

3. Assessment procedures and prac- 
tices include testing, student goal-set- 
ting performance measures, and other 
performance measures. 

4. Iowa's ABE program is meeting 
the needs of its adult clientele as docu- 
mented by Iowa's ABE target population 
studies and Iowa's GED norming study. 
Correlations/cross-references: See the 
profiles for "Reasons for Nonpartcipa- 
tion Among Iowa's Adults Who Arc Eli- 
gible for ABE/' on page 20, and "Iowa's 
Norming Study of the Tests of General 
Educational Development," on page 7. 

Also, this study is referenced in 
"Adult Basic and Literacy Education As- 
sessment Instruments Evaluation 
Handbook," profiled below. 
Contact information: 
Dr. John Hartwig 
Division of Community Colleges 
Iowa Department of Education 
Grimes State Office Building 
Des Moines, I A 50319-0146 
SI 5-28 1-3636 
For copy of full report: 
ERIC 



Adult Basic and Literacy Education 
Assessment Instruments Evaluation 
Handbook 

Project #99-1009 

Date: 1991 

State: Pennsylvania 

Contractor: Adult Education Linkage 

Services, Troy, PA 
Purpose: To survey ABLE programs in 
Pennsylvania to determine what test- 
ing/assessment programs were in use, 
to review the literature on testing/as- 
sessment instruments relevant to ABLE 
in Pennsylvania, and to prepare a hand- 
book containing survey and literature- 
review findings. 

Procedure: A complex set of color-coded 
survey forms was mailed to every fed- 
erally and state-funded ABE/Literacy 
program in Pennsylvania and to all 
other state directors of adult education 
asking for information on the tests they 
most commonly use with adult stu- 
dents. Five of the project's panel mem- 
bers, all of whom were well informed 
on adult assessment, each conducted 
five facc-to-face interviews with per- 
sons associated with testing and assess- 



8 



RESEARCH D I S T I I L E D | 



ment in selected programs. Based on 
both survey responses (in a very high 
return rate) and the literature review, a 
handbook was compiled containing rec- 
ommendations for assessing adults' 
educational performance, information 
derived from the project's surveys, com- 
ments on individual standardized tests, 
and a section on alternative assessment. 
Summary of findings: Numerical survey 
findings in the form of charts, presented 
in the project's handbook product, 
called Testing &? Assessment: Adult 
Basic and Literacy Education in the 
Commonwealth of Pennsylvania, arc 
not readily conclusive, nor are findings 
clearly delineated in the final report. 
From the handbook charts it would ap- 
pear that the standardized tests most 
commonly used in Pennsylvania at the 
time of the study were: TABE, ABLE, 
Woodcock-Johnson, and WRAT, for ABE 
students; Official GED Practice Test, for 
GED candidates; and Slosson SORT, for 
ESL students. Other tests in use were: 
BEST, Brigancc, Cambridge Scries, Con- 
temporary Series, GED Test, Laubach 
Wav & Challenger, LVA ESL Oral, LWR 
Checkups, Scott-Foresman Scries, 
Steck-Vaughn Series, and teacher-made 
tests. 

The handbook also describes types of 
standardized tests being used (norm-ref- 
erenced, criterion-referenced, compe- 
tency-based, curriculum-based) and sur- 
vey respondents' ratings of the negative 
aspects of commonly used standardized 
tests. Findings of the literature review 
arc scattered throughout. 
Comments: While the handbook this 
project produced contains a great deal 
of valuable information, its layout and 
overall organization make it difficult to 
access. The typewritten booklet is ar- 
ranged in sections rather than consecu- 
tively numbered pages, and the se- 
quence of topics appears somewhat ar- 
bitrary. The final report contains scant 
text on the project's methodology, prob- 
ably assuming that the full set of forms 
and letters used in the project and pro- 
vided in the report adequately complete 
the picture. This documentation defi- 
ciency is unfortunate, since the project's 
important premise, extensive efforts, 
and useful findings arc not described in 
a clear, accessible form. 
Correlations/cross-references: Refer- 
enecs to and excerpts from related lit- 
erature make the handbook, despite its 
weaknesses, an integral resource on the 
subject of assessment. The chart com- 
paring standardized test instruments, 
by Dr. Meryl Lazar of the University of 
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Pittsburgh, is particularly valuable. In 
1993 it was updated by Dr. Lazar and 
reproduced for Adult Learner Assess- 
ment: A Learning Packet, written by 
Tana Reiff for the Tri-Valley Literacy 
Staff Development Center at Lehigh 
University. 

Follow-up: The ABLE Bureau at the 
Pennsylvania Department of Education 
revised some of their information con- 
cerning testing and assessment as a re- 
sult of this project's findings. Due to the 
large response to the handbook, a fol- 
low-up project was proposed; however, 
it was not funded. 

Contact information (for those who 
have already read the final report): 
David W. Fluke 

Adult Education Linkage Services 
Box 214 
Troy, PA 16947 
717-596-3474 
For copy of full report and handbook: 
PA State Literacy Resource Centers 



Alternative Assessment Measures in Adult 
Basic Education Programs 

Project #98-1048, DAEL #SA-302 

Date: 1991 

State: Pennsylvania 

Contractor: University of Pittsburgh, 

Pittsburgh, PA 
Purpose: To develop and implement a 
comprehensive assessment system (uti- 
lizing both standardized and alternative 
measures) in existing adult education 
programs; long range: to create guide- 
lines for adult literacy providers for de- 
velopment of such an assessment sys- 
tem. 

Procedure: Four ABE program sites, 
each with j different instructional fo- 
cus, participated in the study. All par- 
ticipating students were given a stan- 
dardized prc-tcst (a different one at each 
site) for screening. Then a link between 
instruction and assessment was estab- 
lished so that appropriate alternative as- 
scssmcnts could be developed and 
implemented. 

Program A's alternative methods 
were writing and reading-strategy 
worksheets. Program B, a GED prepara- 
tion program, never fully developed its 
alternative measure. Program C used 
peer evaluation of writing. Program D, 
a secretarial training program, used 
some self-evaluation of written work 
and frequent instructor feedback, but 
little was documented, thus ongoing in- 
formal assessment was never fully 
implemented. Much of the work of this 
project focused on identifying and ana- 



lyzing curricular goals and activities. 
Summary of findings: "Although there 
is still work to be done in conceptualiz- 
ing and training adult educators in the 
use of alternative assessment measures 
in their programs, it is a viable adjunct 
to the requisite standardized testing. Al- 
ternative measures will enable both stu- 
dents and instructors to know what the 
instructional program is accomplishing 
at any given time and to make adjust- 
ments as needed. Instructors can have a 
better sense of the knowledge the adults 
bring to the program and the gaps in 
knowledge the program can work to fill 
... we need to develop a better under- 
standing of how to better assess what 
adults bring to the instructional setting 
and what programs need to provide 
instructionally to make a difference. 
Well defined assessment programs offer 
the potential for assisting programs in 
making this difference." 
Comments: More time than expected 
was spent on analysis of instruction. 
Less time than expected was spent on 
alternative assessment. 

Due to high attrition and fluctuating 
attendance in the participating pro- 
grams, full implementation of alterna- 
tive assessment was difficult and post- 
testing was incomplete. 
Correlations/cross-references: The body 
of literature on alternative assessment 
is growing, though, at this writing, 
much of it is more a survey of the lit- 
erature than original research, and 
much of the research is inconclusive 
though promising. However, the follow- 
ing resources provide two of the better 
overviews, if slightly out of date: Busi- 
ness Council for Effective Literacy 
Newsletter (January 1990) and Informa- 
tion Update: Special Issue on Alterna- 
tive Assessment. Literacy Assistance 
Center Newsletter (September 1989). 
Follow-up: In 1993 Drs. Lazar and Bean 
produced "A Staff Development Model 
for Use of a Comprehensive Assessment 
System in Adult Literacy Programs." 
Also funded under Section 3S3 (PA 
Project #99-3009). That proje. t found 
that instructors need to understand 
more about literacy learning and that 
"informal assessment can be integrated 
only when outcomes are clear to all." 
This involves three phases: 1 ) awareness 
of the theoretical elements of good lit- 
eracy instruction, 2) development of 
meaningful instructional experiences 
supported by ongoing assessment, and 
3) application of informal assessment in 
the program. 
Contact information: 
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Drs. Meryl K. Lazar and Rita M. Bean 

University of Pittsburgh 

Institute for Practice and Research 

in Education 

5T23 Forbes Quadrangle 

Pittsburgh, PA 15260 

412-648-7210 
For copy of full report and follow-up 
paper: 

PA State Literacy Resource Centers 
or 

DAEL Clearinghouse 

For complete copy of the test mea- 
sure3, contact the University of Pitts- 
burgh address above. Enclose $4.00 to 
cover copying and mailing. 



Assessing Ind : duals with Learning 
Differences, Problems and Disabilities 

PA Project #98-2024 

Date: 1992 

State: Pennsylvania 

Contractor: Center for Alternative 

Learning, Bryn Mawr, PA 
Purpose: To produce a screening instru- 
ment, simplified from an earlier ver- 
sion, which adult basic educators can 
use to identify learning problems; also 
to demonstrate the instrument to adult 
educators throughout Pennsylvania and 
develop a video to assist adult educators 
in using the instrument. 
Procedure: The project director simpli- 
fied an instrument he had developed 
earlier (the original document was not 
compared), into the "Cooper Screening 
of Information Processing." Described 
as something between a standardized 
test and a self-administered checklist, 
the instrument uses "an interview dur- 
ing which the scrcencr asks questions 
about past performance and makes ob- 
servations through samples of reading, 
writing and math to identify processing 
problems and academic skills." The in- 
strument was then demonstrated (not 
field-tested) on 50 students in ten ABE 
programs throughout Pennsylvania. 
Summary of findings: The project direc- 
tor developed "a learning-disabilities 
screening instrument ... useful in iden- 
tifying processing difficulties." The in- 
strument is easy to administer, but, as 
the report indicates, the screcner needs 
to have an understanding of learning 
problems in adults in order to interpret 
results. The report recommends attend- 
ing a workshop or viewing the videotape 
before administering the screening in- 
strument. 

Comments: An answer in the affirma- 
tive to many of the questions in the 
Cooper Screening of Information Pro- 



cessing would likely be derived from 
virtually anyone, not just learning-dis- 
abled adults. For example, questions 
such as Do you talk too much! or Do 
you consider yourself a loner} may char- 
acterize a person with a learning disabil- 
ity, but there is no apparent means here 
to draw such generalizations. 

The screening relics a great deal on 
the subject's self-knowledge of cogni- 
tive processes. For example, it would 
appear to be difficult for anyone to pro- 
vide an objective answer to the question 
Do you have difficulty with grammar! 

On a broader scale, the screening 
asks more than a lay person is capable 
of answering. Do any of your siblings 
have learning problems! Can an adult 
student answer that question with a 
simple "yes" or "no"? 

Many of the questions identify spe- 
cific skills deficiencies {e.g. a tendency 
to write run-on sentences) but not 
learning disabilities per sc. 

There is no indication that the in- 
strument was modified in any way af- 
ter it was demonstrated on the 50 stu- 
dents in the field; therefore, the instru- 
ment was apparently not field-tested as 
such. 

The strongest parts of the screening 
instrument arc those, such as the hand- 
writing analysis, that require the 
screcner to actually observe perfor- 
mance, rather than simply ask oral 
questions. However, the report contains 
no gu delincs for interpreting any of the 
answers, only a number of sample re- 
ports written by the developer. The ac- 
companying video contains consider- 
ations for determining how answers 
should be recorded, along with an ap- 
parently useful summary sheet, but 
these provisions are absent from the 
project report. 

The "external evaluator" was iden- 
tified by name only; the report supplied 
no other information or credentials on 
this person. Further, there was no ap- 
parent basis for the cvaluator's calling 
the project a success, only that the 
project met its goals. This may indeed 
be a valid instrument foi screening 
learning disabilities in adults, but there 
is no data to support that conclusion. 
Contact information: 

Dr. Richard J. Cooper 

Center for Alternative Learning 

30 Summit Grove Ave. 

Bryn Mawr, PA 19010 

610-525-8336 
For copy of full report and video: 

PA State Literacy Resource Centers 



Results of Field Research: ABE/ESL 
Assessment 

DAEL #SA-225 
Date: 1992 
State: Washington 

Contractor: Northwest Regional Educa- 
tion Laboratory, Portland, OR 
Purpose: As stated in the final report, 
"to develop an assessment model for 
Washington State Adult Basic Educa- 
tion and English as a Second Language 
programs." This included field research 
with adult learners, teachers, volun- 
teers, and administrators. 
Procedure: Research was conducted in 
three tiers: 1) interviews with eight 
"key players" representing a variety of 
ABE/ESL settings throughout the state; 
2) focus-group discussions with stu- 
dents, teachers, and administrators on 
current assessment practices and issues; 
and 3) a questionnaire survey of "indi- 
viduals representing various stake- 
holder groups (e.g. adult learners, teach- 
ers, volunteers, and administrators)" to 
provide "a broader base on attitudes, 
current practices, and needs regarding 
ABE/ESL assessment." 
Summary of findings: The final report 
presents the findings of all three tiers of 
the study in detail, though it draws no 
cumulative conclusions. Some high- 
lights: 

The standardized tests most com- 
monly used in Washington were the 
CASAS (the state's mandated instru- 
ment), TABE, and ABLE. Several others 
were mentioned as well. ESL students 
generally were taking cither the BEST 
or the Washington State Adult Refugee 
Project tests. Tests were usually admin- 
istered by nonprofessional staff. 

Among the "key players" inter- 
viewed, the major issues or concerns 
regarding the tests were: 1 ) absence of a 
link between Washington's CORE com- 
petencies and CASAS; 2) lack of coordi- 
nation between program sites and spon- 
soring agencies regarding assessment 
results and duplication; 3) ineffective 
assessment practices; 4) confusion 
about the ability of one instrument to 
serve several different purposes of as- 
sessment; 5) use of assessment informa- 
tion to judge teachers' performance; 6) 
test-administration issues: cost of tests, 
time required per learner, and ease of ad- 
ministration; 7) lack of local-program 
autonomy regarding assessment; 8) lack 
of follow-up counseling; 9) difficulty in 
assessing the ABE/ESL population, due 
to high mobility and attrition rates; and 
10) "Pollyanna view" that alternative 
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assessment methods can successfully 
replace standardized testing. 

When asked to describe desired as- 
sessment systems, key players cited the 
need for multiple measures, test user- 
friendliness, an exit component, and 
other factors. They also suggested 
greater integration of assessment with 
instruction in various ways. 

Focus groups of ABE/ESL staff pro- 
vided details on current practices in in- 
take, placement, and diagnosis, con- 
cerns about assessment comparable to 
those offered by the "key players," and 
ideas for integrating assessment into 
classroom practice. Student focus 
groups indicated they appreciated tests 
for providing information on their 
progress. 

The questionnaire survey provided a 
great deal of additional in-depth infor- 
mation on ABE and ESL assessment 
practices and areas for improvement. 
Comments: The 1988 federal reporting 
mandate brought the issue of assess- 
ment into the spotlight. Though the 
study was conducted in one state, the 
final report contains a wealth of infor- 
mation on assessment issues that surely 
would be applicable to other states. As 
such, anyone interested in assessment 
would find the report worthy of reading 
in its entirety. 

Correlations/cross-references: This 
project bears similarities to the Penn- 
sylvania project "Adult Basic and Lit- 
eracy Education Assessment Instru- 
ments Evaluation Handbook" (page 7). 
The Washington project provides much 
more detail on current practices and 
feelings about assessment but not as 
much hard data on specific instru- 
ments. 

Contact information: 

Ann E. Davis 
Kim O. Yap 

Northwest Regional Educational 
Laboratory 

101 SW Main St., Suite 500 
Portland, OR 97204 
503-275-9500 
For copy of full report: 
DAEL Clearinghouse 

Iowa's Adult Basic Education Programs: A 
Survey of Learner Demographics and 
Preliminary Skill Levels 

Date: 1993 
State: Iowa 

Contractor: Comprehensive Adult 
Student Assessment System, San 
Diego, CA 
^ D "rpose: To provide baseline informa- 



tion about three target adult popula- 
tions (special education, adult basic 
education, and English as a second lan- 
guage) enrolled in adult basic education 
programs in Iowa during the spring of 
1993. 

Procedure: Survey findings were based 
on a sampling of 495 adult basic educa- 
tion students participating in programs 
at 15 community colleges. The report 
states: "Although representative, the 
sampling conducted was not statisti- 
cally random. However, the results are 
consistent with other studies of the 
same populations conducted over the 
past several years. Both demographic in- 
formation and test results should be in- 
terpreted with some degree of caution." 
Summary of findings: Among special- 
education students (all Caucasian, na- 
tive English speakers), 43% could rec- 
ognize certain words and phrases and 
3% could read basic materials. 

Nearly half of the ABE students were 
able to read at a "high school entry 
level" (CASAS score of over 231); how- 
ever, math scores were significantly 
lower (CASAS score of below 214). Of 
those below high-school level, 3% per- 
cent of the sample scored at a level in- 
dicating great difficulty with everyday 
reading; 18% were able to read simple 
everyday materials, and 25% could read 
everyday materials but were not ready 
for high-school-level courses. 

English as a second language stu- 
dents surveyed were Indochincsc 
(mostly Vietnamese), Asian (from sev- 
eral countries), and Hispanic. Most 
scored within CASAS levels A and B in 
listening and within levels B and C in 
reading. 

Comments: This study was essentially 
a broad administration of the CASAS 
(Comprehensive Adult Student Assess- 
ment System) by the instrument's pro- 
ducers. Details of the six delineated 
CASAS levels is provided to assist with 
interpreting test scores. Demographic 
information on the survey particioants 
is also provided. This is one of several 
accountability studies undertaken in 
Iowa. 

Correlations/cross-references: The 
CASAS instrument is an assessment of 
functional-context literacy skills. This 
application of the test instrument pro- 
duced a general picture of Iowa's ARE 
population. The use of CASAS is grow- 
ing widely for use in assessing indi- 
vidual adult learners, often in work- 
place-literacy situations. 
Contact information: 
Dr. John Hartwig 



Division of Community Colleges 
Iowa Department of Education 
Grimes State Office Building 
Des Moines, IA 50319-0146 
515-281-3636 
For copy of full report: 
Same as above 



Verifying Applied Literacy Skills in ABE 
Programs 

PA Project #98-3043 
Date: 1993 
State: Pennsylvania 
Contractor: Lehigh County Commu- 
nity College, Allentown, PA 
Purpose: To 1) investigate the degree to 
which the ETS Tests of Applied Literacy 
Skills (TALS) may be used in predicting 
GED success, 2) ubtain baseline data on 
applied skills of Allentown area adult 
students which can be compared to 
state (VALS) and national (NALS) lit- 
eracy scores, 3) demonstrate greater 
learning gains and retention rates in the 
experimental group when compared to 
a traditional GED program, and 3) de- 
termine the level of post-program stu- 
dent success in meeting goals. 
Procedure: Control and experimental 
groups were selected by recruiting 71 
adult students enrolled in GED prepa- 
ration classes at Lehigh County Com- 
munity College, City Site. Based on the 
results of administering the Tests of Ap- 
plied Literacy Skills (the ETS-designed 
instrument which was used to measure 
the document, prose, and quantitative 
literacy levels in the National Adult Lit- 
eracy Survey), as well as the ABLE test, 
to all participants, the students were di- 
vided into two groups of roughly equiva- 
lent mixes of academic levels. 

The control group was taught by one 
instructor using "a traditional ABE ap- 
proach and materials," defined as in- 
struction with an emphasis on vocabu- 
lary and comprehension (reading); spell- 
ing, grammar, usage on essay produc- 
tion (writing); and number operations 
on whole numbers, fractions, decimals 
and percents (mathematics); i.e. regular 
commercial GED preparation materials. 
With a different instructor as well as a 
counselor/instructor, the experimental 
group worked with "applied literacy 
skills," including study skills, word- 
processing applications with computers 
in conjunction with their essay writing, 
and the Simon & Schuster Applied Lit- 
eracy Skills "real-life" materials for ex- 
tra practice and homework. The experi- 
mental group also received periodic 
counseling (one time per month for 1 .5 
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hours). Over six months, 100 instruc- 
tional hours were completed. 
Summary of findings: TALS Prose Lit- 
eracy scores did not predict scores on 
the GED Practice Literature and the 
Arts subtests. There was a moderate 
correlation between the TALS Quanti- 
tative Test and the GED Practice Math- 
ematics subtest, but the former should 
not be considered a strong predictor. On 
the other hand, if the learning goal is 
job training, then the TALS v/ould be 
the appropriate instrument to use. 

The experimental group showed no 
better retention rates than the control 
group, no better learning gains, and no 
greater goal accomplishment. In other 
words, "there were no major differences 
between the experimental and the con- 
trol groups/' Learning gains did occur 
in both groups, "but neither performed 
significantly better than the other." 
Comments: The report concedes several 
points: 1) that the "small sample size 
may not have been sufficient to be con- 
fident of results," 2) that the project 
worked on the faulty assumption: "that 
preparation for the GED is equivalent 
to preparation for the world of work," 
ami 3) that the variable of two different 
instructors may have confounded re- 
sults. 

This is, however, a thorough and 
well-written report of a generally well- 
designed project and should contribute 
to the growing body of research on the 
TALS. The final report documents the 
project exceptionally well. Every aspect 
and detail is presented clearly and in 
standard academic terminology and for- 
mat, aside from several handwritten 
notes on the statistical pages. The 
project design, with modifications, 
would provide a model for correlating 
studies. 

Correlations/ cross-references: Correl a - 
tions to the National Adult Literacy 
Survey (NALS) and Pennsylvania Adult 
Literacy Survey (PALS) were desired but 
impossible at the time of this project 
because neither study had yet released 
its final report. 

Because NALS and PALS findings 
were unavailable, the project compared 
scores to those of the Department of 
Labor's 1990 study with unemployment 
and JTPA participants; LCCC's GED 
students' average scores were compa- 
rable to that study, though fewer LCCC 
students scored at the lowest levels. 
Follow-up: Part of the study was a fol- 
low-up student survey. Half of the par- 
ticipants were interviewed by phone 
Q ding what they were currently do 



ing, career goals, reasons for wanting a 
GED, plans for taking the test, and feel- 
ings about various aspects of the class 
in which they had participated. Survey 
data was integral to the study's conclu- 
sions. 

Contact information: 

Joan K. Lipiec 

Lehigh County Community College 
609 Hamilton Mall 
Allentown, PA 18101 
610-776-1998 
For copy of full report: 

PA State Literacy Resource Centers 
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Section Two 

Curriculum and instruction 



Do Dialogue Journals Increase the Writing 
Skills of Adult Students in One on One 
Literacy Instruction? 

PA Project #98-0011 
Date: 1990 
State: Pennsylvania 
Contractor: Allcntown Literacy Coun- 
cil, Allcntown, PA 
Purpose: To investigate the effective- 
ness of training tutors to use dialogue 
journals with students in an adult lit- 
eracy program by comparing the writ- 
ing samples of student-tutor pairs using 
dialogue journals exclusively with pairs 
not using dialogue journals and to de- 
velop or adapt scoring procedures for 
dialogue journals that can be used with 
tutors. 

Procedure: For the experimental group, 
15 tutor-student pairs were trained and 
monitored in the use of dialogue jour- 
nals. Student writing samples produced 
by this group (using dialogue journals 
exclusively) were compared to those of 
the control group's student writing, 
which was not in the form of dialogue 
journals. Nine pairs in each group com- 
pleted the study. 

Written samples were analyzed over 
five months for the number of words 
used, varied vocabulary, readability (us- 
ing the Gunning Fog index), and num- 
ber of errors. The first and last samples 
for each student were compared to de- 
termine whether increases or decreases 
had occurred in each of the variables. 
The two groups produced a total of 68 
writing samples. 

Summary of findings: Increases in writ- 
ten vocabulary were achieved by 89% 
of the control group and 67% of the ex- 
perimental group. The control group 
used an average of 2.6 times more words 
in their last sample than in the first; the 
experimental group used 1.9 times more 
words. Seven of the nine control-group 
students showed increased readability 
levels, compared to two of the nine ex- 
perimental-group students. Students 
using dialogue journals, however, wrote 
more often and with fewer errors. 

A frequent comment of tutors and 
students in the experimental group was 

desire to discuss errors and correc- 

ERIC 



tions, which v/as considered antitheti- 
cal to the concept of dialogue journals. 

The researchers concluded that the 
study was unable to determine whether 
dialogue journals improve writing abil- 
ity. Several factors, such as the individu- 
ality and highly contcxtualizcd nature 
of dialogue journals, could not be taken 
into account in a study such as this one. 
Comments: The final report describes 
four teaching implications as a result of 
this study,- however, it is unclear how 
these conclusions were drav n based on 
the information produced by the study 
and provided in the report. For example, 
the statement "Dialogue journals 
should be incorporated into an overall 
writing program for adults ... but should 
not be used exclusively as the means to 
encourage writing" is not supported by 
study data. The listed implications are 
reasonable common-sense assumptions 
but not necessarily conclusions of this 
study. 

Although the study is interesting, it 
is based on a tenuous premise: that use 
of dialogue journals has greater poten- 
tial to improve writing than the use of 
traditional writing instruction — or any 
combination of techniques. Moreover, 
the study sample was very small. 

The section describing the procedure 
for dialogue journal writing and the ac- 
tual student-tutor samples are interest- 
ing and useful. 

Correlations/cross-references: The final 
report refers to earlier studies concern- 
ing dialogue journal writing, particu- 
larly Peyton and Staton (1989), Rutledge 
(1988), Staton (1987), and Staton ct al. 
(1983). 

Contact information: 

Dr. Linda V. McCrossan, Executive 
Director 

Cynthia D. Garrett, Program 
Director 

Allentown Literacy Council 
530 Hamilton Street 
Allcntown, PA 18101 
610-435-0680 
For copy of full report: 

PA State Literacy Resource Centers 
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An Examination and Evaluation of Large 
Computer Systems for Use in Adult Basic 
Education Programs 

DAEL #SA-1102 
Date: 1990 
State: Washington 

Contractor: Adult Basic Skills Consor- 
tium at the Washington State Adult 
Basic Education Center for Program 
& Staff Development 
Purpose: Through several carefully de- 
signed survey instruments, to identify, 
examine, and describe five large com- 
puter-based integrated learning system * 
offering remediation of adult bask- 
skills. 

Procedure: A preliminary survey of ABE 
programs in Washington, Oregon, and 
British Columbia identified which com- 
puter systems were in use and for what 
purposes. An Advisory Committee was 
formed to assist in developing an exten- 
sive evaluation document which was 
subsequently used in full-day on-site 
visits to selected programs using large 
computer-based instructional systems 
with adult students. (This instrument, 
as well as a checklist form of it, may be 
used by any program desiring an in- 
depth evaluation of computer systems.) 
The evaluation produced a scries of gen- 
eral and specific issues for consideration 
in selecting an integrated learning sys- 
tem. 

The five systems evaluated by this 
study were (with their publishers in pa- 
rentheses): CCC (Computer Curricu- 
lum Corporation), CCP (Comprehen- 
sive Competencies Program), 
ClassWorks (Computer Networking 
Specialist), PLATO (The Roach Organi- 
zation), and WICAT (W1CAT Systems). 
Model installation sites were selected 
by publishers' representatives. Both stu- 
dents and staff were interviewed during 
the on-site visits. 

Summary of findings: General issues ex- 
amined produced the following conclu- 
sions: None of the integrated learning 
systems required experienced computer 
staff; however, one used a technical lab 
manager, all needed some clerical assis- 
tance, and in every case, a qualified in- 
structor was the most important factor 
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in determining success or failure of a 
system. All systems required some de- 
gree of staff training. Systems needed to 
be housed in rooms large enough to ac- 
commodate the desired number of 
workstations and instructional materi- 
als, with adequate electrical service, 
ventilation, and security. All the sys- 
tems were able to accommodate flexible 
student-attendance patterns. With the 
addition of software, student worksta- 
tions could be utilized for other pur- 
poses, such as training in word process- 
ing or computer programming. 

Specific issues examined produced 
the following information on each of 
the five systems: 1 ) brief description, 2) 
program where observed, 3) cost factors, 
4) hardware configuration, 5) system 
quality, 6) the system's assumptions 
about learning, 7) instructional design, 
8) built-in assessment and placement 
instruments, 9) instructional delivery, 
10] feedback to students, 1 1) usability 
(user-friendliness), 12) modifiability, 13) 
management of student performance, 
14) records management, 15) support/ 
service, and 16) staff and student re- 
sponse. 

The final report provides detailed 
data on all of the above criteria. 
Comments: Narrative information on 
the five systems examined is compre- 
hensive; however, even though the fi- 
nal report includes a "Summary Ma- 
trix" system comparison chart, the 
project attempted no qualitative com- 
parison of systems. This is not neces- 
sarily a failure of the project, only a note 
that readers will not see bottom-line 
quality ratings as they might in some 
hardware or software reviews. Never- 
theless, this report, and/or applying the 
long or short evaluation instruments to 
other, newer systems, would provide a 
great deal of useful information to any 
program considering purchase of an in- 
tegrated learning system. 
Follow-up: Newer systems are now 
available. 

Contact information: 

Donna Miller-Parker 

Technology Consortium Coordinator 

or 

Dr. Delight C. Willing 
Associate Professor 
Seattle University 
900 Broadway 
Seattle, WA 98122 
For copy of full report: 
DAEL Clearinghouse 
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A Research Study of the 1988/89 Project 
Workplace Literacy 7 s Effect on Worker 
Productivity 

Project #98-0017 

Date: 1990 

State: Pennsylvania 

Contractor: Central Intermediate Unit 

#10 Development Center for Adults, 

Lock Haven, PA 
Purpose: To evaluate improvement in 
reading, writing, mathematics, and ba- 
sic computer literacy proficiency levels 
and to identify changes in worker pro- 
ductivity, efficiency, and morale of em- 
ployees who had participated ' .1 the pre- 
vious year's workplace literacy project. 
Procedure: Managers, supervisors, and 
workers at a Champion plant who had 
participated in a Statistical Process 
Control (SPC) and computer literacy 
program were surveyed and productiv- 
ity statistics were compared to those de- 
rived from a control group of workers at 
a nonparticipating plant. A separate 
management survey was developed, dis- 
seminated, collected, and analyzed. A 
limited number of employees cooper- 
ated with the study because, according 
to the personnel office, union members 
were reluctant to record any responses 
that might contribute in any way to a 
positive image of plant management. 
Therefore, the researchers contacted the 
workers by phone after hours to explain 
their independence from plant manage- 
ment. This effort elicited responses 
from 57 of the 97 workers (17 no longer 
worked for the company). 
Summary of findings: Of the 97 partici- 
pants tested, 95 met or exceeded the 
level considered mastery of the reading 
and math concepts taught, indicating an 
average improvement of 2.5 grade lev- 
els. 

In the computer literacy proficiency 
assessment, workers who had partici- 
pated in the previous year's program 
scored an average of 8.9 out of 10 ques- 
tions. The control group scored an aver- 
age of 8.5 out of 10. This was consid- 
ered an insignificant difference. 

Survey results indicated that em- 
ployees who had participated in the SPC 
program had a significantly better un- 
derstanding of how their jobs fit into the 
company as a whole and how the pro- 
duction process could be improved and 
were more confident of their ability to 
handle new challenges than the control 
group. As derived from a separate sur- 
vey, management productivity was in- 
creased due to a decrease in production 
line errors. 



Assessment of moral was "impos- 
sible given the ongoing labor dispute." 
Comments: The study was undertaken 
in the midst of considerable labor un- 
rest. The report cautions that employee 
responses were certainly colored by that 
atmosphere and that study results must 
be interpreted with this in mind. 
Correlations/cross-references: The 
project on which this study was based 
is called "Workplace Literacy for 
Clinton County," PA project #98-9023, 
FY 1989. 

For copy of full report: 

PA State Literacy Resource Comers 

A Study of CAI/CAV Laser Disk Technology 
in the Adult Classroom 

PA Project #98-0052 
Date: 1990 
State: Pennsylvania 
Contractor: Altoona Area School Dis- 
trict, Altoona, PA 
Purpose: To compare the results of a 
computer-assisted interactive iascr disk 
program (IBM) with a computer-assisted 
non laser disk program (Apple) in teach- 
ing mathematics in adult basic educa- 
tion. Evaluating cost effectiveness of 
the laser-disk delivery system was also 
an objective. 

Procedure: One group of 50 adult stu- 
dents utilized the ISC interactive laser 
disk program, developed in conjunction 
with Millersville University. Running 
on an IBM Info-Window system, the 
program "provides both visual and au- 
ditory response when presenting an ex- 
planation and/or responding to a cor- 
rect/incorrect response by the student." 
A second group of 25 students used the 
Skills Bank GED Series, a typical com- 
puter-assisted instructional program. 
Both groups also used MECC software 
on Apple II GS computers for drill and 
practice. A third group of 21 students 
received math instruction involving no 
computers at all. To avoid the 
"Hawthorne effect," all students uti- 
lized both computer systems for En- 
glish, career-exploration, and reading in- 
struction. 

Due to several major problems be- 
yond the control of the project itself, the 
project was not fully carried out. 
Summary of findings: Students using 
both the laser-disk and traditional CAI 
systems for math instruction p "duccd 
significantly greater learning gams than 
the group using no CAI. Comparison of 
pre- and post-test data, as well as stu- 
dent and staff responses, supported the 
administrative decision to purchase the 
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interactive laser disk equipment, 
though it was considerably more expen- 
sive than the Apple II system. That con- 
clusion was based on a combination of 
subjective and objective factors: exit in- 
terviews, test data, and program obser- 
vation*; showed that the majority of 
teachers and students clearly preferred 
the interactive laser-disk system because 
they found it more stimulating to use. 
Comments: One of the problems en- 
countered in this study echoes that of 
many other studies of ABE students, 
that because they arc highly transient, 
not enough participants remain for the 
duration of the study. 

Bureaucratic problems, including 
project approval halfway through the 
fiscal year, an unrelated school district 
political situation, and the unan- 
nounced withdrawal of the project con- 
i ultant, a doctoral candidate from Penn 
State, illustrate how ABE research can 
be jeopardized by administrative forces 
beyond the project itself. 
Correlations/cross-references: This 
project was conceived on the premise 
that CAI produces greater learning gains 
and good cost-effectiveness as outlined 
in a 1987 Section 3 10 project, "Comput- 
ers and Software: A Utilization Survey." 
Contact information: 

Gerald L. Valcri 

Federal Programs Coordinator 

Altoona Area School District 

Fifth Avenue and Fifteenth Street 

Altoona, PA 16602 

814-946-8366 

or Vincc Ncdimycr 

Community Ed. Center Director 

814-946-8267 
For copy of full report: 

PA State Literacy Resource Centers 



Auditory Aspects of Reading/Writing 
Instruction 

PA Project #98-2009 
Date: 1992 
State: Pennsylvania 
Contractor: Delaware County Literacy 
Council 

Purpose: To teach adult literacy stu- 
dents through an auditory approach to 
reading and writing instruction and to 
evaluate their progress against that 
made by students taught by traditional 
visual methods. 

Procedure: A certified audiologist was 
retained to train tutors in auditory 
teaching approaches. Student-partici- 
pants in the study were solicited from 
among new enrollecs and divided into a 
q control group of eight students (visual) 



and an experimental group of nine (au- 
ditory). (This was not group learning; 
each student had an individual tutor.) 
Students were pretested at intake, and 
the project intended to retest at subse- 
quent intervals of 10, 20, and 30 hours 
of instruction to compare reading gains 
in the two groups. 

The project was severely impaired by 
the illness of the audiologist's mother, 
for whom the audiologist was the pri- 
mary caregiver. Subsequently, three ses- 
sions for training tutors in the auditory 
method did not begin until January of 
the project year, allowing inadequate 
time for actual tutoring in the two 
methods. 

Also, three students in the experi- 
mental group expressed discomfort 
with the absence of textbooks and with- 
drew from the study. 
Summary of findings: Despite the criti- 
cal limitations of the project, there were 
some potentially significant findings 
(though this project was unable to verify 
them). Post-testing revealed slightly 
higher reading gains in the control 
group; however, five individual gains 
(out of nine participants) in the experi- 
mental group were achieved in less time 
than in the control group. Also, stu- 
dents in the control group "logged more 
hours in a more consistent manner." 
J This is a project that may have raised 
more questions than it answered. For 
I example, the final report notes a pos- 
sible connection between each group's 
"immediate response to the techniques 
and subsequent success. Could this in- 
dicate a 'marriage' of learning modality 
or is it a reflection of attitude?" Also, 
did students in the control group per- 
form better because they felt more com- 
fortable with the traditional approach? 
Comments: Several observations may 
contribute to future projects comparing 
auditory and visual approaches to teach- 
ing adult reading — a potentially worth- 
while exercise. 

First, the design of this study may 
have been flawed. Perhaps, had students 
first been tested for learning-modality 
preferences, the study might, more val- 
idly, have compared gains in two groups 
of auditory learners. Without any indi- 
cation of modality preference, a study 
using this one's basic design could fea- 
sibly be comparing a control group of 
auditory learners being taught through 
visual methods to an experimental 
group of visual learners being taught 
through auditory methods, which 
would produce nothing more than a 
learncr-to-mcthod mismatch. . 



A second design flaw may be that any 
approach to teaching reading that does 
not encompass both visual and auditory 
learning may be inherently doomed to 
lower success rates. 

Finally, the grantee may have been 
able to follow through as planned if a 
replacement audiologist could have 
been brought into the project early on. 

The final report contains numerous 
auditory activities that would be useful 
in any literacy program. These alone arc 
worth a look. 
Contact information: 

Patricia Rcitz Gaul 

Delaware County Literacy Council 

225 E. 24th St. 

Chester, PA 19013 
For copy of full report: 

PA State Literacy Resource Centers 



Discovery Learning Project 

Project #98-2058 
Date: 1992 
State: Pennsylvania 
Contractor: Fayette County Commu- 
nity Action Agency, Inc. 
Purpose: To evaluate the effectiveness 
of the LVA "focal model" by comparing 
reading gains in two groups of adult stu- 
dents using the LVA collaborative dis- 
covery method of literacy instruction 
and "focal points" with two groups us- 
ing the same method but without focal 
points, and in comparing the LVA 
groups to one group using the standard 
Laubach method. 

Procedure: The Literacy Volunteers of 
America (LVA) focal model refers to an 
instructional system using LVA meth- 
ods and materials in conjunction with 
studying a life-skills top icof critical in- 
terest to the adult students in a particu- 
lar group. 

In this project, tutors attended five 
hours of training (in iwo sessions) on 
the use of LVA material:* ?nd methods 
in small-group tutoring situations; this 
was a departure from the onc-on-onc tu- 
toring to which they were accustomed. 
The agency then recruited four small 
groups of students (two to nine each), 
with an average reading level of 4.5. Stu- 
dents were pre- and post-tested using 
the WRAT. Each group met from eight 
to 16 times. Two of the groups focused 
on the topics of parenting, budgeting, 
and life skills while involved with col- 
laborative LVA instruction. This in- 
volved discussing the topic, then re- 
sponding to it through reading, speak- 
ing, and writing, including rewriting, 
editing, and group assessment. Students 
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were encouraged to tackle life tasks by 
breaking them into steps, formulating 
strategies, testing and refining strate- 
gies, and completing the task. The other 
two groups used collaborative LVA only, 
without focal topics. The Laubach 
group continued using Laubach Literacy 
materials. Attendance of all groups was 
monitored. 

Summary of findings: The two collabo- 
rative LVA groups with focal points 
scored reading gains of 1.25 and 1, re- 
spectively. The two non-focal groups 
scored gains of 1 .5 and .75. These differ- 
ences arc considered negligible. How- 
ever, while attendance in the focal 
groups was 62% and 61%, attendance 
in the non-focal groups was 88% and 
79% and group interaction was better 
and personal attitudes more positive in 
the non-focal groups. The non-focal 
group with the least reading gains did 
not have individual tutors. 

The project's final report surmises 
some reasons for the more negative at- 
titudes of the focal groups. One of the 
groups, comprised of senior citizens, 
was reluctant to share private experi- 
ences, though they competed for the 
tutor's attention to the "best life expe- 
riences. " The result was a tense atmo- 
sphere. The other focal group, com- 
prised of persons who had experienced 
spousal abuse, exhibited greater differ- 
ences in educational and economic 
backgrounds than anticipated. 

"Confounding factors," such as 
learning disabilities, in the Laubach 
group, "prohibited this group from serv- 
ing as a suitable control group." There- 
fore, "the study did not prove a correla- 
tion between accelerated learning and 
focal groups." 

Another factor contributing to nega- 
tive feelings in the focal groups was the 
tutors' discomfort with a collaborative 
environment in which they were re- 
quired to expose their own personal is- 
sues. Some felt this "wes reminiscent 
of a support group rather than an "aca- 
demic group striving to achieve." 
Comments: This project took on the 
ambitious and fascinating task of com- 
paring adult reading instructional meth- 
ods. However, they did so on an insuffi- 
ciently low budget (total project budget 
was only $4,500) and immediately en- 
countered the difficulty of forming ad- 
equately comparable groups of adult 
reading students. The virtually equiva- 
lent reading gains between the focal and 
non-focal groups, the continuing pres- 
ence of individual tutors in one group, 
q 1 the attitudinal differences — mostly 
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attributable to extracurricular vari- 
ables — produced inconclusive results to 
a worthwhile exercise. However, a pos- 
sibly inadvertent finding of the project, 
disregarding the influence of group com- 
position, was that the non-focal groups 
exhibited a more positive attitude to- 
ward the learning situation than the fo- 
cal groups, who were required to share 
personal feelings. 

Correlations/cross-references: Little re- 
search has been done to compare reading 
gains in adults using various instructional 
methods. This is one study in that di- 
rection, and though inconclusive, it il- 
lustrates the need for further work in 
this area, as well as the inherent diffi- 
culties of conducting such studies. 
Contact information: 

Kim Hawk 

Director of Education 

Fayette County Community Action 

Agency, Inc. 

137 N. Beeson Ave. 

Uniontown, PA 15401 

412-437-6050 
For copy of full report: 

PA State Literacy Resource Centers 



Exploring the Comprehension Skills and 
Strategies of ABE Students 

PA Project #98-2003, ERIC #ED352527 
r>-te: 1992 
State: Pennsylvania 
Contractor: Institute for the Study of 
Adult Literacy, Pcnn State University 
Purpose: To research the comprehen- 
sion skills and strategics of ABE stu- 
dents as a first step in comparing them 
to proficient readers in developing in- 
structional methods. 
Procedure: A questionnaire modeled on 
those used in earlier, comparable re- 
search projects (mostly with children) 
and sample reading passages were used 
to interview 55 ABE students, reading 
at levels 5-9, at two sites (Altoona and 
State College). Students were asked 
questions regarding: 1) what they know 
about reading comprehension, them- 
selves as comprchenders, and compre- 
hension strategies (what makes some- 
one a good reader?), 2) their ability to 
detect comprehension failure while 
reading, and 3) what, if any, strategics 
they use at these failure points. Three 
versions of each selected reading pas- 
sage were presented: one in normal 
form, one with a sentence in scrambled 
word order, and one containing a con- 
tradictory sentence. Answers to the 
three open-ended interview questions, 
as well a read-aloud sample, were tape- 
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recorded. The other answers were re- 
corded on paper. 

Summary of findings: The majority of 
responses to the first open-ended ques- 
tion, "What do you think makes some- 
one a really good reader?", fell into three 
categories: practice, 53%; understand- 
ing what is read, 34%; and liking what 
is read (motivation), 16%. 

On the second open-ended question, 
"If I gave you something to read right 
now, how would know if you were read- 
ing it well?", 45% fell into one category: 
global understanding, while 17% said 
they wouldn't know if they were read- 
ing well. 

The third open-ended question, 
"What do you think makes something 
difficult to read?", allowed multiple re- 
sponses, and 63% of responses were in 
the "reader/text interaction: word 
level" category: that difficult words 
would make a passage difficult to read. 
Another 40% of responses fell into the 
"reader/text interaction: text-level" cat- 
egory: that texts, that didn't interest 
them or about which they had no prior 
knowledge would be difficult. And 32% 
of responses fell into the "text" cat- 
egory: that factors such as small print 
or poor organization would make some- 
thing difficult to read. 

In the second part of the question- 
naire, regarding comprehension strate- 
gies, about one-third of responses indi- 
cated "an appreciation of the impor- 
tance of comprehension and a knowl- 
edge of sound comprehension strate- 
gics." 

In the part of the study on detecting 
scrambled or contradictory sentences, 
66% were able to detect scrambled sen- 
tences, but only 35% detected the con- 
tradictory sentences. No one detected 
the problems without first being ques- 
tioned about them. The one-third who 
detected problems also used strategies 
to deal with them. However, most of 
the ABE students disregarded the prob- 
lems even if they noticed them. 
Comments: All reading passages, ques- 
tionnaires, and survey coding informa- 
tion are provided in appendices. These, 
along with a detailed description of the 
project's thorough methodology, make 
this a comprehensive report of a serious 
research project. Findings presented in 
chart form would be easier to access 
than gleaning them from the text. 
Correlations/cross-references: A signifi- 
cant body of research exists on readers' 
mctacognition (knowledge of one's own 
cognition, particularly with regard to 
the reading process), of which this 
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project and its director's 1988 doctoral 
dissertation arc part. This report refers 
to three related papers: Myers and Paris 
(1978), Gambrell and Heathington 
(1981), and Garner and Kraus (1981-82). 
Several others, including Boraks and 
Schumacher (1981) and Meyer and 
Keefe (1988), also correlate the general 
finding that poor readers tend to view 
reading more as a process of naming 
words than of seeking meaning. This 
Penn State study did find slightly higher 
metacognition levels than other stud- 
ies, but the adults were reading at some- 
what higher reading levels than in other 
studies involving ABE students. 

Helping adult beginning readers fo- 
cus on meaning and develop compre- 
hension strategies is the major thrust of 
whole-language instruction. This Penn 
State study contributes to a growing 
body of research in this area, though 
this study steps beyond its predecessors 
by concentrating on the reading prac- 
tices, comprehension strategies, and 
motivations of adult students in par- 
ticular. 

A summary of this project by its di- 
rector, along with a bibliography of 
metacognition and comprehension 
studies, appears in Mosaic: Research 
Notes on Literacy, February 1993, Vol 
3, No. 1, the newsletter of Penn State's 
Institute for the Study of Adult Literacy. 
Follow-up: At this writing, Dr. Forlizzi 
is developing ideas for follow-up study 
but has not yet completed a proposal or 
follow-up study. She has expressed her 
willingness to be contacted by persons 
interested in this study. 
Contact information: 

Dr. Lori Forlizzi 

Inst, for the Study of Adult Literacy 
Penn State University 
204 Calder Way, Suite 209 
University Park, PA 16801-4756 
814-863-3777 
For copy of full report: 

PA State Literacy Resource Centers 
or ERIC 

or Study monograph available from: 
ISAL (address above). Cost: $27.00 



High-Tech for Effective ESL/Family Literacy 
Instruction 

PA Project #98-9010, ERIC ED #356683 
Date: 1992 
State: Pennsylvania 
Contractor: Drcxcl University, Phila- 
delphia, PA 
Purpose: To study educational effective- 
ness of CD-ROM-based computer-as- 
sisted instruction in ESL and Family 
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Literacy curriculum, specifically in the 
area of language acquisition, as well as 
for retention/attendance and staff devel- 
opment, and as a showcase for CD- 
ROM applications in adult education. 
Procedure: Thirty beginning/higher be- 
ginning ESL/family literacy students at 
the Indochinese-Amcrican Council's 
Community Service Center of Drexel 
University, Philadelphia, were divided 
into one control group and two experi- 
mental groups (based on level). All par- 
ticipants were pre-tested. All spent one 
hour per week in a regular ESL class and 
another hour reading children's literacy 
materials. Both groups used print mate- 
rials, but the experimental group also 
used Proficiency and Discis software on 
CD-ROM on Apple Macintosh Plus 
computers. After completing the in- 
structional packages, students were 
post-tested and exit-interviewed. 
Summary of findings: Based on com- 
parisons of pre- and post-test scores, the 
experimental adult LEP groups, who 
had used the computer-aided instruc- 
tion along with print-based instruction, 
experienced greater mean gains than the 
control group, which had used only 
print-based materials. Attendance/re- 
tention rates were higher in the experi- 
mental group as well. Exit interviews 
indicated that enthusiasm was also 
higher in the experimental group. How- 
ever, for CAI to significantly enhance 
learning in an ESL/family literacy pro- 
gram, a great deal of human interaction 
is necessary. 

Comments: The report acknowledges a 
difficulty in forming ethnically equiva- 
lent control and experimental groups 
(one was mostly Cambodians, the other 
a mixture of Vietnamese and Chinese). 

There is a virtually no other research 
on CD-ROM-based CAI in ESL and fam- 
ily literacy; therefore, this project is 
"just a beginning." 

The project experienced software 
problems: the version of Proficiency 
software used was not completely stable 
or reliable, and the Discis software was 
not appropriate for adult learners. How- 
ever, the program reported having had 
good, readily available technical sup- 
port. 

The ESL curriculum as presented in 
this study was not holistic. 
Correlations/cross-references: This 
study reinforced conclusions of numer- 
ous other studies (Balson ct al., 1985- 
86; Terrell, 1990; Fletcher, 1990; see 
footnotes in report) which have indi- 
cated that, in general, CAI helps stu- 
dents learn more and perform better 



than when using conventional class- 
room methods alone. 
Foliow-up: Dr°xel University and the 
Mayor's Commission on Literacy con- 
duct an annual Computers and Adult 
Literacy Conference each May. 
Contact information: 

Dr. Vuong G. Thuy 

Executive Director 

Tndochinesc-Ameri.can Council 

4934-36 Old York Rd. 

Philadelphia, PA 19141 

215-457-0272 
For copy of full report: 

PA State Literacy Resource Centers 

or ERIC 



Small Group ABE/DHHR Tutoring Project 

Date: 1992 

State: West Virginia 

Contractor: Mason County Literacy 

Council, Inc., Lakin, WV 
Purpose: "To demonstrate the effective- 
ness of small group tutoring in prepara- 
tion for entering the ABE program [us- 
ing space for two groups provided by the 
coun-y office of the Department of 
Health and Human Resources, Work 
and Training Division] ... One group is 
instructed using the collaborative ap- 
proach; the other uses a standard struc- 
tured approach. Both use daily living 
materials in addition to more standard 
curriculum." 

Procedure: It is unclear whether the 
project's stated purpose is to compare 
the "collaborative" and "structured" 
groups or to evaluate small-group tutor- 
ing in general. Either way, the program 
appears to have been carried out less 
than methodically. Neither the terms 
collaborative nor structured arc ever 
defined; the implication is that collabo- 
rative refers to a whole-language ap- 
proach and structured to a Laubach- 
typc phonics approach. No useful de- 
tails of program implementation arc 
provided. The final report lists only a 
few notes on securing instructional 
materials, assisting adult students with 
transportation and flexible scheduling, 
and simply being prepared to work with 
students' children "on some level." 
Summary of findings: Project "findings" 
have little relation to project objectives. 
There are some anecdotal notes on 
group composition. One statement pro- 
vides some comparison between the 
"collaborative" and "structured" ap- 
proaches: "An unstructured program 
(the collaborative group?] made these 
students uncomfortable and they were 
unable to perform in such a lesson." On 
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the other hand, a later statement indicts 
the "structured" approach as well: 
"Members of the structured group were 
easily intimidated by introduction of 
new materials and methods." One 
statement addresses group learning in 
general, favoring neither approach to 
reading instruction: "The group dynam- 
ics were supportive of the learning pro- 
cess and enhanced skills acquired. The 
informality and lack of tension in this 
[which?] small group setting contrib- 
uted to the students' being at case with 
the materials in use." The final report 
also notes an erratic attendance pattern. 
Comments: It is unclear what this 
project actually set out to accomplish. 
The final report is very sketchy, with 
little information on how the project 
carried out its objectives (unfocused 
though they were) and with no evalua- 
tion data whatsoever, other th.in brief 
progress notes on four individual stu- 
dents. It appears that the project was 
less of a demonstration or experiment 
than a way to fund a new tutoring pro- 
gram at a new site. 

Correlations/cross-references: This is 
another attempt, ostensibly at least, to 
compare instructional approaches. If 
nothing else, this project does point out 
some of the difficulties of conducting 
longitudinal studies of adult learning in 
the context of a real setting. Attendance 
problems, logistics, and group dynam- 
ics, not to mention the project develop- 
ers' lack of focus and an absence of true 
control variables, result in no reliable 
conclusions. Any project comparing in- 
structional approaches must consider 
mechanisms for encountering such pre- 
dictable factors. 
Contact information: 
Jessica Jones 

Mason County Literacy Council, Inc. 
One Batcman Circle 
Lakin, WV 25287 
304-675-6076 or 882-3799 
For copy of full report: 

Center for Adult Literacy and Learning 
RESA III 
501 22nd St. 
Dunbar, WV 25064 

Software Evaluation and Manual for 
Kentucky Adult Education Programs 

Date: 1992 
State: Kentucky 

Contractor: Longfellow Adult Learning 

Center, Owcnsboro, KY 
Purpose: To evaluate at least 1 50 software 
programs for consideration to be used in 
Kentucky Adult Learning Centers. 



Procedure: A standard evaluation form 
was designed and used to evaluate 174 
software programs in the following ar- 
eas: Subject and Content, Cost, hard- 
ware Requirements, Installation, De- 
gree of Student Independence, Record- 
Keeping and Assessment features, Cor- 
relation to Standardized Tests, and 
Technical Support. Findings were orga- 
nized and compiled into a Software 
Evaluation Manual 
Summary of findings: The 1 74 software 
packages which were evaluated were 
found to be of varying usefulness for 
adult learners. Details are available in 
the Software Evaluation Manual which 
this project produced. In addition, two 
staff development workshops were con- 
ducted to introduce adult educators to 
the method for evaluating software. 
Comments: The manual was not avail- 
able to review for this summary. 
Contact information: 
Susan Fariss 

Longfellow Adult Learning Center 
1716 Frcdcrica Street 
Owensboro, KY 42301 
502-686-1150 
For copy of full report and manual: 
Kentucky State Literacy Resource 
Center 

Office of Adult Education Services 
403 Wapping St. 
Frankfort, KY 40601 



Effectiveness of Group Instruction in Adult 
Literacy Acquisition 

PA Project #98-3034 
Date: 1993 
State: Pennsylvania 
Contractor: Greater Pittsburgh Lit- 
eracy Council 
Purpose: To contrast the reading-level 
gains and personal goals accomplish- 
ment of adult students taught in col- 
laborative learning groups with those in 
one-to-one tutoring situations. 
Procedure: Led by consultant Daniel 
Hibbs Morrow, Ph.D., 20 adult students 
were placed in three small groups and 
1 1 with individual tutors. All students 
were both exposed to a learner-gener- 
ated curriculum. All were pre- and post- 
tested with the reading comprehension 
subscalc of the Adult Basic Learning Ex- 
amination (ABLE) and the Slosson Oral 
Reading Test (SORT) of word recogni- 
tion. Information about personal goals 
accomplishment was collected from the 
annual Pennsylvania Department of 
Education student data forms and this 
literacy council's intake interview and 
follow-up forms. 



Summary of findings: Students in one- 
to-one instruction scored significantly 
higher post-test gains than group-in- 
struction students, though "magnitudes 
of gain were not significantly different 
from one another." 

A number of correlations between 
test scores and student demographics 
were also obtained. Among them, there 
was a "negative correlation between 
rate of reading comprehension gain and 
years of formal schooling" and a "posi- 
tive correlation between gain and age/' 
This was offered as a possible explana- 
tion for the greater gains by the one-to- 
one students, since they were generally 
older and had completed fewer years of 
formal schooling. 

Neither group reported accomplish- 
ing their goals, but one-to-one students 
reported a higher proportion of goal ac- 
complishment than the group-instruc- 
tion students. 

Comments: The autlors concede the 
possibility that the one-to-one learning 
environment may be more conducive to 
both goal setting and reporting of goal 
accomplishment due to the personal re- 
lationship established between student 
and tutor. 

The report is professionally written 
and provides clear graphs and charts. 
Correlations/cross-references: The re- 
port would be more useful had it cited 
related literature and provided more 
background on the reasons for conduct- 
ing this study. As written, however, it 
provides a useful model for replication. 
Contact information: 

Donald G. Block 

Executive Director 

Greater Pittsburgh Literacy Council 

100 Sheridan Square 

Pittsburgh, PA 15206 

412-661-7323 
For copy of full report: 

PA State Literacy Resource Centers 



Reading Together (Toward a Collaborative 
Approach to Parent Involvement: The 
Implications of Parents' Beliefs) 

PA Project #98-3029 
Date: 1993 
State: Pennsylvania 
Contractor: Temple University, Phila- 
delphia, PA 
Purpose/background: While most exist- 
ing approaches to involving parents in 
the educational process assume that 
parents' existing skills need to be re- 
placed by "more desirable" values, 
newer approaches encourage a more re- 
ciprocal arrangement. However, col- 
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laborative approaches to parent involve- 
ment tend to assume that all members 
of a cultural group represent a common 
value system. This study sought to 
elicit young African American mothers' 
beliefs about learning and literacy and 
to identify their shared goals in an ef- 
fort to create a collaborative approach 
to parent involvement in an early-inter- 
vention program. 

Procedure: Rather than administer stan- 
dardized inventories to collect parents' 
beliefs, the project chose an open-ended, 
peer-discussion format. A scries of dis- 
cussions was held with 19 single, Afri- 
can American mothers, all on welfare, 
aged 17 to 22, with one to three chil- 
dren, aged two months to 6 years. Nine 
of the women were enrolled in an adult 
basic education program and ten in a 
GED program, with their children in an 
affiliated day-care program. Five discus- 
sion groups met several times, totaling 
ten hours each. Discussions were tape- 
recorded for later analysis. 
Summary of findings: The mothers in 
this group "did not share a common 
world view." Their beliefs about learn- 
ing and literacy "reflected several dif- 
ferent child-development perspectives, 
broadly defined along a continuum of 
transmission, maturational, and trans- 
actional beliefs." Therefore, any as- 
sumption that intergroup differences 
represent a "homogeneity of experi- 
ences for families within a particular 
culture" is "unwarranted." 

This study did, however, indicate 
shared goals among the women: 1) the 
desire that their children thrive both so- 
cially and intellectually, 2) that the 
school provide a safe environment, 3) 
the belief that a good teacher is one who 
maintains respect, and 4) the desire to 
be positive role models to their children 
and to attain the skills to be so. Where 
the women differed was in the methods 
they preferred for attaining these com- 
mon goals. Nevertheless, all of the goals 
arc highly compatible with those of the 
school. 

The findings were applied to parcnt- 
involvemcnt collaboration in the 
children's day-care program to make it 
more congruent with parents' beliefs. 
For example, two literacy-based play 
settings (a kitchen and a library with 
low shelves) were introduced, and the 
children's day was restructured to in- 
clude at least 15 minutes of storybook 
reading, 1 5 minutes of a goal-structured 
learning activity, and a free-play period 
in the literacy- related settings. 

In addition, the parent-education 
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classes were restructured to include 
regular involvement in the day-care pro- 
gram. 

Comments: The final report provides 
much more detail of parents' responses 
and applications to the program. 
Though the report does not provide sta- 
tistical reporting of all responses, a con- 
cise and potentially useful table docs 
summarize well the continuum of per- 
spectives the mothers expressed. 
Correlations/cross-references: The re- 
searchers' thorough search of the litera- 
ture produced an extensive bibliography 
of related studies, several of which this 
study succeeded in disproving. 

It would appear that this study 
should be essential reading for anyone 
involved in a program of parent-school 
collaboration, and it would not be sur- 
prising to see it emerge as an important 
contribution to the literature on this 
subject. 

Contact information: 

Susan B. Neuman 
Temple University 
437 Ritter Hall 
Philadelphia, PA 19122 
215-204-4982 
For copy of full report: 

PA State Literacy Resource Centers 



Technological Solutions for Homebound 
Adult Learners 

Date: 1993 
State: West Virginia 
Contractor: James Rumscy Technical 
Institute and The Total Learning Re- 
search Institute, Martinsburg, WV 
Purpose: To conduct a national search 
for effective, technology-based methods 
for assisting homebound adult basic 
education students in rural areas. This 
included searching the literature, de- 
signing a technology-based approach for 
local implementation, and developing a 
local pilot. 

Procedure: The study team identified 
existing computer-based, interactive 
services for homebound ABE students. 
They then developed a set of criteria for 
determining applicability of the tech- 
nology to West Virginia ABE and sur- 
veyed ABE providers in the state (61% 
response rate) to seek information and 
opinions on home interactive learning. 
The team identified ABE providers in- 
terested in piloting such systems and 
federal funding sources to do so, but, 
due to cost limitations, did not actually 
conduct a pilot study. 
Summary of findings: The study 
reached six main conclusions: 1 ) Several 



technology-based instructional options 
arc currently available for homebound 
adult learners: in-home computing us- 
ing approved courseware, take-home 
computer programs, telephone trans- 
mission of computer-assisted instruc- 
tion, video on demand (future), multi- 
media broadcast networks (future), and 
electronic bulletin-board services (in 
limited use nationally: R. ^MEK from 
IMSATT, PLATO 200 from TRO Learn- 
ing, and, NovaNET, which was deemed 
most appropriate to the West Virginia 
clientele). Most of these options would 
require each homebound student to 
have a computer and a modem. 2) Cur- 
rent technology-based options fail at 
least one criterion for cost-effective 
implementation, that at the time of the 
study NovaNET was not available on a 
dial-up basis and so would require con- 
siderable start-up expense to develop an 
infrastructure to support the system. 3) 
Emerging technologies do offer signifi- 
cant promise for widespread cost-effec- 
tive implementation, through several 
new multimedia interactive networks 
that will soon be available directly to 
the home. 4) ABE providers in West Vir- 
ginia arc interested in offering technol- 
ogy-based curricula for homebound 
adult learners; though a majority of sur- 
vey respondents did not currently offer 
homebound instruction, a greater num- 
ber were interested in being pilot sites 
for an interactive computer-assisted 
program. 5) Federal (e.g. Department of 
Defense) and foundation (e.g. Kenan 
Trust) grants are available for applying 
interactive technology to home use. 6) 
Offering widespread technology-based 
programs to homebound ABE students 
in West Virginia would be premature at 
this time due to high start-up costs; 
however, imminent availability of 
NovaNET through the online service 
CompuServe would alter this conclu- 
sion. 

Comments: The study team appears to 
have conducted a comprehensive re- 
view of existing applications of com- 
puter-based instruction for homebound 
ABE students. The project's clear, well- 
written final report would be a valuable 
resource for anyone investigating dis- 
tance-education solutions. 
Correlations/cross-references: The final 
report lists several programs throughout 
the U.S. which have tried or are cur- 
rently using NovaNET and other tech- 
nology-based networks and programs 
for homebound students at all levels. 
Contact information: 
Jill Weekly 
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James Rumsey Technical Institute 
Route 6, Box 268 
Martinsburg, WV 25401 
304-754-7690 
For copy of full report: 

Centerfor Adult Literacy and Learning 
RESA III 
501 22nd St. 
Dunbar, WV 25064 



Visual Literacy: A Neglected Component 

PA Project #98-3007 
Date: 1993 
State: Pennsylvania 
Contractor: Institute for the Study of 
Adult Literacy, Pcnn State University 
Purpose: To 1) adapt an existing, visu- 
ally oriented educational model for use 
with adults, 2) develop a curriculum- 
based assessment to analyze the model, 
3] train ABLE instructors in use of the 
program, 4) implement and evaluate the 
project, 5) disseminate projects findings. 
Procedure: A GED teacher and a life- 
skills teacher at Tuscarora Intermediate 
Unit Adult Education and Training 
Center in Lcwistown, Pennsylvania, 
were trained to implement a program 
emphasizing visual literacy to 27 stu- 
dents. Materials included the novel The 
Black Pearl by Scott O'Dcli; a film ad- 
aptation of the novel, caUcd The Sacred 
Cave ; poster- sized prints of scenes from 
the movie; and an audiocassette of the 
movie soundtrack. Activities involved 
learners in reading, writing, discussion, 
and mathematics. The model carried 
students through four steps: visualizing, 
inquiring, reading, and applying. Ten 
students were pre- and post-tested, us- 
ing an instrument developed in this 
project, on general vocabulary, Spanish 
vocabulary, general knowledge, and at- 
titudes. 

Summary of findings: "Students 
showed gains in knowledge of general 
vocabulary and Spanish vocabulary 
froin the beginning to the end of the 
project. There was some indication that 
studcr.ts held a more positive attitude 
toward fiction at the end of the project. 
Teachers and students felt that the ma- 
terials and activities aided comprehen- 
sion and thinking skills development. 
Both teachers and students were enthu- 
siastic about the program." 
Comments: As the project's abstract 
notes, the findings should be verified 
comparing an experimental group with 
a control group. 

Correlations/cross-references: The 

project was developed in response to 
^"^carch by Mallery and Swimmer 
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( 1 992) to build activities that fi t " . . . the 
learning styles, content backgrounds, 
and skill levels of a specific target audi- 
ence" and writers such as Kazcmck 
(1992) who "have called for an increased 
focus on developing literacy for personal 
growth and enjoyment." 
Contact information: 

Drs. Lori A. Forlizzi and 

Eunice N. Askov 

Inst, for the Study of Adult Literacy 
Pcnn State University 
204 CaldcrWay, Suite 209 
University Park, PA 16801-4756 
814-863-3777 
For copy of full report: 

PA State Literacy Resource Centers 



The Year in Review, Volume 2: 1992- 
1993, Reports of Research Conducted by 
Adult Education Practitioner-Researchers 
From Virginia 

Date: 1993 
State: Virginia 

Contractor: Virginia Adult Educators 

Research Network 
Purpose: The general goal was to report 
on practitioner research projects on five 
topics, conducted in local programs in 
Virginia. The purposes of each of the 
projects reported on were: 1 ) To explore 
better ways to link class activities to 
learner lives and learning. 2) To study 
factors related to student retention in 
adult education. (This was done at three 
different sites.) 3) To investigate the rea- 
sons well-prepared students delay tak- 
ing the GED test. 4) To survey adult 
education teachers who had conducted 
collaborative action research about 
changes experienced as a result. 5) To 
examine the use of calculators in math- 
ematics education. 

Methodology: The Virginia Adult Edu- 
cators Research Network assisted in 
coordinating the five action research 
projects. Each researcher or team of re- 
searchers prepared a report of their ac- 
tivities, including an introduction, a lit- 
erature review, a description of meth- 
ods used, findings, and suggestions for 
further research. 

Summary of findings: The findings of 
each project, very briefly and incom- 
pletely stated, were as follows: 

1. The 15 adult learners participated 
in an average of 12.9 outsidc-of-class 
learning activities. While a pre-test sur- 
vey indicated that none was satisfied 
with their level of outsidc-of-class ac- 
tivity, the post survey indicated that 
35% were now satisfied. 

2. Two focal points of the study— the 
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relationships to retention of student re- 
sponsibility for learning and the phe- 
nomenon of bonding in the classroom — 
both showed promising avenues for 
deeper inquiry. Overall, findings were 
anecdotal and no solid conclusions 
could be drawn. The study noted that 
individual programs should not assume 
to know the causes of retention difficul- 
ties but to conduct specific local re- 
search. 

3. Fear of both failure (e.g. test anxi- 
ety) nnd success (e.g. reluctance to stop 
attending well-liked classes) were the 
dominant reason for learners' delaying 
taking the GED. 

4. Overall, teachers viewed their col- 
laborative action-research experiences 
positively, but their concerns were: un- 
certainty of the process, lack of re- 
sources, large quantity of time and work 
involved, difficulty of writing, and lack 
of support. 

5. This was a literature review with 
no study conclusions but a great deal of 
information on the history and use of 
calculators in math instruction. 
Comments: The publication briefly de- 
scribed here presents an excellent 
model for coordination and reporting of 
practitioner action research. 
Correlations/cross-references: The Vir- 
ginia Adult Educators Research Net- 
work has also produced The Adult 
Educator's Guide to Practitioner Re- 
search ($5.00) and other publications for 
potential action researchers. 
Follow-up: The Network plans to con- 
tinue and expand, including communi- 
cating and coordinating with other re- 
search institutions. 

Contact information: 

Suzanne Cocklcy 

Virginia Adult Educators Research 

Network 

P.O. Box 10 

290 Mill Street 

Dayton, VA 22821 

800-336-6012 (in VA) 

703-879-2732 
For copy of full report: 

Virginia Adult Educators Research 

Network 

Address above. Cost: $5.00. 
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Section Three 

Participation and Retention 



Strategies for Success: A Study on ABE 
Student Retention 

ERIC #ED290952 

Date: 1987 (included here because of 

relation to other retention studies) 
State: North Carolina 
Contractor: Coastal Carolina Commu- 
nity College, Jacksonville, NC 
Purpose: To learn why adult basic edu- 
cation students drop out and what pro- 
grams can do to keep them attending 
and learning. 

Procedure: Printed survey forms asking 
about interferences with attendance 
and feelings about ABE classes were dis- 
tributed to former students who had 
dropped out of North Carolina ABE pro- 
grams, current students, ABE instruc- 
tors, and ABE directors between the fall 
of 1985 and the winter of 1987. The 
number of forms returned was 158 from 
the non-continuing students, 199 from 
current students, 13 from ABE instruc- 
tors, and 41 from ABE directors. 
Summary of findings: The top problems 
affecting ABE student attendance were 
identified as: transportation, child care, 
conflicts with working hours, family, 
and financial. 

A variety of implications for improv- 
ing adult student retention were drawn 
from the survey findings: 

1 . Student contact is an integral part 
of ABE retention efforts. 

2. The rate of no-shows can be de- 
creased through individual contacts. 

3. A more flexible schedule is ben- 
eficial to ABE students. 

4. Retention strategics can be effec- 
tively employed to decrease the dropout 
rate of ABE students. 

Other implications from the findings 
address quality of instruction, suitable 
program structures, and effectiveness of 
support services. 

Comments: Implications are drawn 
from the survey, not from modified pro- 
gram practices. 

There may be an inherent flaw in us- 
ing a print document to survey adult 
student dropouts who may be poor read- 
ers. 

Correlations/cross-references: Several 
^other studies on student retention arc 
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profiled in this section. In comparison 
to those later studies, this one appears 
somewhat superficial but it probably 
helped to lay groundwork for subse- 
quent studies. 
Contact information: 

Sheila Jackson-Mayer 

E. Christina Cunningham Howie 

Paula M. Lanvcrmeier 

Coastal Carolina Community College 

444 Western Blvd. 

Jacksonville, NC 28540-8877 

919-455-1221 
For copy of full report: 

ERIC 



Designing Delivery Systems for Adult 
Education in Rural Areas 

PA Project #98-9015 

Date: 1989 

State: Pennsylvania 

Contractor: Mansfield University, 

Mansfield. PA 
Purpose: To identify effective instruc- 
tional strategics for target rural ABE and 
GED populations, specifically to identify 
existing delivery systems, rural adults' 
and ABE/GED teachers' preferred deliv- 
ery systems and referral -agency contacts, 
and to provide a survey instrument and 
research design that could be replicated 
in other rural counties. 
Procedure: Subjects were selected from 
state-funded ABE/GED programs in 23 
rural Pennsylvania counties. Separate 
surveys were designed and mailed to 
teachers, tutors, program administra- 
tors, and students. Returned surveys 
were coded by county, percentage of re- 
sponses was tabulated for each item, 
and data was analyzed to determine pre- 
ferred delivery systems. 
Summary of findings: A substantial data 
set led to the conclusions that: 1 ) trans- 
portation or transportation subsidies 
and child-care provisions should be 
made to maximize participation, 2) pub- 
lic buildings arc the preferred instruc- 
tional settings, A) evening classes or tu- 
torials are preferred by more students 
but many preferred morning and after- 
noon classes, 4) Monday through Thurs- 
day are preferred class days, and 5) 
classes should meet two times per week 



for 2.5-3 hours (employed students pre- 
ferred shorter classes). Teachers, tutors, 
and students agreed that providing tele- 
phone conferences would improve par- 
ticipation. Teachers and tutors felt that 
more combinations of regular class- 
room instruction and one-to-one tutor- 
ing should be offered; employed stu- 
dents agreed, but unemployed students 
preferred more one-to-one tutoring. All 
groups liked the idea of videotapes for 
home instruction, though more teach- 
ers, tutors, and referral-agency person- 
nel than students liked the idea of les- 
sons via public television. All groups 
liked the idea of computer and corre- 
spondence lessons at home. 
Comments: This study appears to pro- 
vide a useful model for rural programs 
seeking to assess preferred instructional 
delivery systems in their own areas. 
Correlations/cross-references: A brief 
literature review and bibliography pro- 
vide a context for this project's purposes 
and methodology. 
Contact information: 

Celeste Burns Scxauer 

Mansfield University 

Learning Research Center 

Mansfield, PA 16933 
For copy of full report: 

PA State Literacy Resource Centers 



Reasons for Nonparticipation Among 
Iowa Adults Who Are Eligible for ABE 

ERIC #ED290048 
Date: 1989 
State: Iowa 

Contractor: Western Iowa Tech Com- 
munity College 
Purpose: While many recruitment-re- 
lated studies focus on why people 
choose to attend adult basic education 
classes, this study sought to discover 
reasons why Iowa adults who are eli- 
gible for ABE do not attend. It was the 
third in a scries of studies conducted 
under Section 310 (now 353) grants in 
Iowa defining the ABE target population 
to assist in planning and policy formu- 
lation. 

Procedure: The study, conducted by Hal 
Bedcr of Rutgers, The State University 
of New Jersey, was based on the premise 
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that the potential ABE population is not 
a single homogeneous group but rather 
is comprised of many subgroups, each 
with different attitudes toward ABE. A 
scrccner survey was sent to 9,000 Iowa 
adults, randomly drawn from a database 
of households in the state, to locate per- 
sons 18 years of age or older without 
high school diplomas who had never at- 
tended ABE classes. Of the 1,321 sur- 
veys completed, 175 were from persons 
eligible and willing to participate in the 
study. From an average of 3.7 phone-call 
attempts per person, 129 persons were 
interviewed by phone with 52 demo- 
graphic and attitudinal questions. 

Earlier studies had estimated that 
ABE was serving only 3% of its target 
population nationwide and that 53% of 
' those people were under age 50. There- 
fore, since the Iowa random sample 
turned out to be mostly persons over 50 
(many of whom had dropped out of 
school during the Depression to work), 
an Expanded Sample was added to bet- 
ter represent the actual, younger ABE 
market. Results of the Basic Sample and 
Expanded (combined) Sample were re- 
ported separately. Also, relationships 
between age and socioeconomic vari- 
ables were analyzed. 
Summary of findings: The six highest- 
scoring reasons for not returning to 
school, of the 32 offered in the survey, 
were: 1) I would feel strange going back 
to school, 2) There aren't many people 
in adult high school classes who arc my 
age, 3) Going back to school would be 
like going to high school all over again, 
4) I am too old to go back to school, 5) I 
don't know anything about adult high 
school classes, and 6) A high school di- 
ploma wouldn't improve my life. 'I ie 
researchers summarize that five of the 
six reasons indicate an attitude among 
nonparticipants that they simply do not 
belong in school. 

Overall, "Persons ... fail to partici- 
pate for four basic reasons: Low Percep- 
tions of Need, Perceived Difficulty, 
Situational Barriers [child care, trans- 
portation, etc.), and Dislike for School. 
With the exception of Situational Barri- 
ers, each deals primarily with percep- 
tions about what ABE is like and how it 
might benefit the individual." 

The implication is that ABE adver- 
tising would do well to project an im- 
age of a warm, caring place for adults to 
come for education. 

Another interesting conclusion of 
this study is that, while ABE exists to 
produce a more literate society, people 
^~nd or don't attend adult school for 
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very individual, not social, reasons. If 
we consider the number of adults who 
attend ABE programs in proportion to 
the number who perceive a need for 
ABE, then the percentage of the target 
population being served is much greater 
than broad studies have estimated. 
Comments: This study appears to have 
been conducted using sound, standard 
research procedure. The emphasis on 
persons without high school diplomas 
can probably be extrapolated to apply to 
low-literate adults specifically, though 
reading level was not a factor in this 
study. 

The final report is well organized and 
well written, adaptable to other states, 
and worth reading in its entirety. 
Correlations/cross-references: This was 
the third of a trilogy of studies con- 
ducted in Iowa under the banner "Iowa's 
Literacy/Adult Basic Education Target 
Population Studies." The two earlier 
studies, "Iowa's Adult Basic Education 
Students: Descriptive Profiles Based on 
Motivations, Cognitive Ability and 
Socio-Dcmographic Variables" and 
"Iowa's ESL Students: A Descriptive 
Profile," were both completed in 1987. 

The Iowa study here profiled rein- 
forced earlier studies, such as Fingeret 
( 1 983), in finding that low perception of 
need for ABE is related to older age. 
This, the study assumes, is probably 
because as people age they tend to de- 
velop a life in which they "get by" ad- 
equately without a high school diploma. 
Contact information: 

Jane B. Sellcn 

Western Iowa Tech Community 
College 
Sioux City, IA 
For copy of full report: 
ERIC 



Reasons for Resistance to ABE and 
Recommendations for New Delivery 
Models and Instructional Strategies for the 
Future 

PA Project #98-0027 

Date: 1990 

State: Pennsylvania 

Contractor: Pcnn State University, 

Center for Continuing and Graduate 

Education, Monroeville 
Purpose: To determine why existing lo- 
cal ABE programs arc not being attended 
by resisting adults, specifically how the 
existing programs arc perceived by re- 
sistors. Also, to investigate alternate de- 
livery systems, instructional models, 
and program materials which rcsistcrs 
may perceive as more relevant. 

O ^ 
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Procedure: Two "professional Black in- 
terviewers" were hired and trained. A 
two-part interview schedule collected 
basic demographic data and was de- 
signed to put interviewees at ease, then 
ask questions relevant to the study. 
Twenty interviews were conducted in 
the Pittsburgh area and tape-recorded. 
Data was then coded, weighted, and cat- 
egorized and patterns analyzed. 
Summary of findings: The primary rea- 
sons rcsisters had dropped out of school 
(it is assumed this meant high school) 
included: teachers, peers, and irrel- 
evance of subject material and of school 
itself. All resistors said they felt "differ- 
ent" in school. ABE rcsisters fell into 
two categories: personal rcsisters and 
cultural/ideological rcsisters. Some also 
felt they were too old to attend. 

The study drew five implications 
from the interviewees' responses: 1) 
ABE course design and marketing 
should be based on potential learners' 
needs assessment, 2) teachers/facilita- 
tors should be sensitive and respectful 
of learners' life experiences, 3) course 
design should build in a component to 
"unlearn" negative associations with 
schooling, 4) poverty works against in- 
tentions to attend (availability, child 
care, transportation, scheduling), and 5) 
further research on the links between 
schooling and resistance, as well as 
demonstration projects to test whether 
improved programs would be better at- 
tended, are needed. 

Comments: The bulk of the final report 
is comprised of full transcripts of all the 
interviews. 

The study had a very small sample 
size (N=20) and subjects were predomi- 
nantly African American (18 vs. 2 
white), female (report says 17 females, 
8 males, which totals 25), in their 30s 
(10), and either on welfare or unem- 
ployed (13). Subjects were solicited for 
participation in the study solely 
through personal contact of two African 
American interviewers with residents 
of a housing project in Pittsburgh. 
Though the project did not set out to 
address the resistance issue beyond a 
local area, the sample clearly is not rep- 
resentative of resistors to adult educa- 
tion in the general population and so 
should not be interpreted as a definitive 
statement on adult-learner resistance. 
By the same token, the method of solic- 
iting study participants castL doubt on 
the validity of applying findingr even to 
the local adult education community. 
Correlations/cross-references: Subse- 
quent research projects conducted by 
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Dr. Quig.ey are described below. Other 
Section 353 research projects addressing 
retention are described in this section 
as well. 

Contact information: 
Dr. B. Allan Quigley 
Associate Professor and Regional 
Director, Adult Education 
Penn State University 
Center for Continuing and Graduate 
Education 

4518 Northern Pike 
Monroeville, PA 15146 
For copy of full report: 

PA State Literacy Resource Centers 



A Research Study in Retention 

PA Project #98-0027, ERIC #ED324471 

Date: 1990 

State: Pennsylvania 

Contractor: The Center for Literacy, 

Philadelphia, PA 
Purpose: To: 1) conduct exploratory 
analysis of existing student and tutor 
data, 2) create working definitions of re- 
tention and attrition, 3) form research 
questions regarding variables to be con- 
sidered, 4) conduct statistical analysis 
of variables affecting retention, 5) draw 
program implications based on statisti- 
cal analysis results, and 6) produce a fi- 
nal report of the study. 
Procedure: The researchers analyzed the 
Center for Literacy's student and tutor 
records from 1985 through 1989 to sum- 
marize demographics and attendance 
patterns. Using this information along 
with staff interviews and a literature 
review, they created working defini- 
tions of retention and attrition and 
formed research questions. Statistical 
analysis was conducted using a range of 
descriptive and inferential statistical 
techniques as well as complex correla- 
tional analyses. The data were analyzed 
using the computer facilities at Re- 
search for Better Schools. Results were 
interpreted, program implications de- 
veloped, and recommendations for fu- 
ture research presented. 
Summary of findings: Variables found to 
have a statistically significant effect on 
student retention were: sex, instruc- 
tional level, age, ethnic membership, 
dependents, employment, previous edu- 
cational experience, handicaps, area of 
residence, and area of instruction. Some 
program implications developed were: 
focusing on specific individualized stu- 
dent goals and interests; increasing stu- 
dent support from staff; topic-oriented 
small-group instruction,- increased flex- 
ibility for special needs,- relevant cur- 
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riculum and materials,- tutor/teacher 
training oriented to specific student 
needs,- ongoing tutor/teacher support; 
meaningful and supportive initial and 
ongoing assessment; portfolio assess- 
ment for increased understanding of 
progress,, processes, and goals,- student 
collaboration,- and drop-in centers for 
transition periods. 

Some significant tutor variables 
identified were: age, educational back- 
ground, and ethnic membership. Pro- 
gram implications were: using tutors as 
classroom aides, using tutors to assist 
in drop-in centers or with special 
projects, providing extra ongoing sup- 
port and training sessions for tutors, 
pairing new tutors with experienced 
tutors for extra support, networking 
with already existing community ser- 
vices, and tailoring support to the needs 
of specific communities. 
Comments: The Purpose, Methodology, 
and Summary of Findings sections 
above are taken almost verbatim from 
the project's report because its abstract 
was arranged in a convenient format, 
similar to that used in this publication. 

The statistical analysis of retention 
patterns appears to provide good 
baseline information for future reten- 
tion studies, particularly within this 
program, though the standard defini- 
tions and data-management procedures 
developed here would apply to any re- 
tention study. The report contains vo- 
luminous statistics and analyses for 
study by serious researchers. 
Correlations/cross-references: The re- 
port provides a useful literature review 
as of 1990. 

Follow-up: The Center for Literacy's "A 
Research Study in Retention: A Quali- 
tative Approach" (1992) is profiled on 
page 23. 

Contact information: 
Marie Vannozzi Knibbc 
The Center for Literacy 
3723 Chestnut Street 
Philadelphia, PA 19104 
or 

Russell A. Duscwicz 
Research for Better Schools 
444 North Third Street 
Philadelphia, PA 19123-4107 
For copy of full report: 

PA State literacy Resource Centers 



Improving Retention in Adult Basic 
Education and Recommended Strategies 
far Effective Instructional and Counselling 
Interventions 

PA Project #98-1053 



Date: 1991 

State: Pennsylvania 

Contractor: Penn State University, 

Center for Continuing and Graduate 

Education, Monroeville 
Purpose: To test the hypothesis that at- 
titudes toward prior school experiences 
are a critical factor in a student's deci- 
sion to persist or drop out of adult basic 
education, and whether intervention 
strategies can be suggested to improve 
retention. 

Procedure: Face-to-facc interviews 
based on the "expectancy-valance par- 
ticipation model" were conducted with 
17 "ABE resistant dropouts" (who had 
dropped out after three weeks or less) 
and 20 "persisters" from ABE programs 
at the Connelley Skills Center and 
Bidwell Training Center in Pittsburgh. 
The interviews surveyed both groups' 
attitudes with regard to 1) past school 
experiences, 2) expectancy levels prior 
to entering ABE, 3) ABE experiences, 
and 4) changes in expectancy levels dur- 
ing or after ABE experiences. 
Summary of findings: The report pro- 
vides findings in much more detail than 
here described. Essentially, rcsistcrs 
considered education important and ex- 
pected ABE to be like school, but found 
it less like school than they expected. 
They entered with few self-doubts, ap- 
preciated the open atmosphere, and 
liked the teachers. In either school or 
ABE, they had made few friends and had 
little support outside of school. They 
were more goal oriented than the 
persisters, wanted a more intense and 
challenging academic program than 
they received, and had not felt close 
enough to teachers to discuss problems 
(the counselor did fulfill that role for 
some). The persisters were found to be 
more neld dependent (less independent) 
and had more positive feelings about 
ABE, more friends, more support out- 
side of school, and a perception of more 
support within ABE. 

In view of the findings, the following 
strategies were recommended: 1) the 
ABE intake person should collect key 
information about the student's past 
and past schooling experiences, 2) more 
attention should be given to those stu- 
dents who need more attention, 3) ABE 
needs to be more academically challeng- 
ing, 4) onc-on-one or small-group tutor- 
ing should be provided to potential 
dropouts, 5) the counselor should under- 
take follow-up on reluctant learners (re- 
sisters). 

Comments: Like the 1990 Penn State 
study profiled on page 21, the sample in 
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this study was very smail and predomi- 
nantly African American (73%), female 
(64.9%), and unemployed or on welfare 
(67.6%). The size and composition of the 
sample limit the applicability of the study 
to the general population or general ABE 
population. 

The report of this study is written in 
comparatively dense academic jargon 
and provides many pages of statistical 
analyses; as such, it will be inaccessible 
to most lay readers. 

Recommendations for improving re- 
tention appear to be based on little sup- 



porting evidence. 

Correlations/cross-references: This 
study follows up two earlier studies by 
Dr. Quigley (1967, 1990), the later pro- 
filed above. It also refers to the Iowa 
study (1989) profiled at the beginning of 
this section and other studies listed in 
this project's final report bibliography. 

A subsequent study by Dr. Quigley un- 
der a 1993 353 grant is profiled below. 

"A Research Study in Retention: A 
Qualitative Approach/ 7 also profiled be- 
low, appears to contradict some of this 
study's assumptions. 



Contact information: 
Dr. B. Allan Quigley 
Associate Professor and Regional 
Director, Adult Education 
Penn State University 
Center for Cont luing and Graduate 
Education 

4518 Northern Pike 

Monroeville, PA 15146 
For copy of full report: 

PA State Literacy Resource Centers 

A revised edition of this and two 
other Quigley studies, Understanding 
and Overcoi nng Resistance to Adult 
Literacy Education, is available as a 
monograph from: 

Inst, for the Study of Adult Literacy 

Penn State University 

204 Calder Way, Suite 209 

University Park, PA 16801-4756 

814-863-3777 

Cost: $35.00 



A Research Study in Retention: 
A Qualitative Approach 

Project #98-2025 
Date: 1992 
State: Pennsylvania 
Contractor: Center for Literacy, Phila- 
delphia, PA 
Purpose: To use qualitative (rather than 
quantitative) research methods to in- 
crease knowledge about student reten- 
tion in adult literacy programs. 
Procedure: A total of 99 individual in- 
terviews were conducted: 47 with ten 
adult students, 19 with tutors, 36 with 
teachers and coordinators. Questions 
explored factors affecting participation 
in this urban program. Information was 
analyzed to identify barriers, obstacles, 
and supports to program participation 
and the way^ in which learners and staff 
viewed dropping out of the program. 
Students were followed from program 
entry for four months or until dropping 
out. 

Summary of findings: The report con- 
cedes that findings arc somewhat con- 
fusing and contradictory but "the) 
point out some interesting things about 
the process of participation in an adult 
literacy program/' In summary, a highly 
individualistic and flexible approach is 
recommended to meet the needs of 
adult learners. 

In this study, only five of the ten fo- 
cus students remain 1 1 in the program 
after four months. 

Findings arc described in the follow- 
ing categories: 

Expectations: Students' expectations 
for the literacy program were not a sig- 



National Evaluation Identifies Retention Data 

Tjie Third Interim Report (January 1994) of the National Evaluation of Adult 
Education Programs (Contract No. LC90065001 with the U.S. Department of Edu- 
cation) provides "Patterns and Predictors of Client Attendance/' a study that re- 
lates to several of the Section 353 retention studies reviewed in this publication. 

Consider the following findings: 

• About 15% of clients in English as a Second Language (ESL), Adult Basic Educa- 
tion (ABE), and Adult Secondary Education (ASE) programs who begin instruc- 
tion leave the program within their first month. 

• 1 1% of clients continue into a second year. 

• About one-third of new clients enroll September and October. 

• Clients who enroll in September and October stay longer than those who enter 
during other months. 

• The median number of hours completed arc: ESL: 77, ABE: 31, ASE: 26. 

• 25% of ESL, 7% of ABE, and 5% of ASE clients receive over 200 hours of instruc- 
tion during their first year. 

• Any type of client who uses support services is more likely to persist than those 
who do not. 

• Any type of client enrolled in day classes is more likely to persist than those 
enrolled in night classes. 

• ESL clients in large classes (31 or more) arc more likely to persist than those not 
in large classes. 

• ABE clients in small programs are more likely to persist than those in large pro- 
grams. 

• ABE clients with only a teacher or a teacher and aide arc more likely to persist than 
those with a teacher plus an independent study or a learning-lab component. 

• ASE clients enrolled in a curriculum emphasizing workplace or life skills arc 
more likely to persist than those in programs emphasizing academic skills. 

• ASE clients in programs serving urban areas, especially large urban areas, arc 
more likely to persist than those in rural programs. 

• ESL and ASE clients in very large programs are more likely to persist than those 
in small programs. 

• ESL and ASE clients enrolled in programs with at least some full-time instruc- 
tional and administrative staff arc more likely to persist than clients in programs 
with only part-time staff. 

• ESL and ASE clients with a learning-lab component as part of their instruction 
arc more likely to persist than clients with only a teacher or a teacher and aide. 

• ESL and ASE clients who received the most hours of instruction were more likely 
to be in low-cost than high- or medium-cost programs. 

• There were no significant differences in the characteristics of clients who at- 
tended 12 hours or more and those who attended 1-1 1 hours. 

For free copies of NEAEP's Interim Reports or a executive summary of the com- 
plete study, call Kate Hanlcy or Laura Williams at 1-800-348-7323 or 703-276-0677, 
or writ'- 'o Development Associates, Inc., 1730 North Lynn Street, Arlington, VA 
22209. la addition, IBM-compatible diskettes are available for linking files through 
a client or program ID number in order to facilitate independent research using the 
q c research model as this study employed. I 
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nificant factor in whether the student 
stayed in the program or not. Students 
did not enter the program with an im- 
age of themselves quitting. Among staff, 
no single profile or combination of 
events assured retention or predicted 
persistence. 

Relationships: As for relationships 
with classmates, a "roomful of learners 
docs not a community make"; support 
from fellow learners cannot be as- 
sumed, and "any research which argues 
that one type of learning context is 
more successful than another, but does 
not actually consider the community 
aspect of a class is lacking important 
data." As for relationships with teach- 
ers, all the students had high praise for 
their instructors. As for relationships 
with others outside of the program, sup- 
port seems to be desirable but it is not 
tied to program participation. 

Obstacles: Some students can and do 
persist despite difficulties, while others 
cannot or do not. As for teachers, fam- 
ily and time pressures make it difficult 
to follow up on student concerns. 

Strategies: Obstacles to learning are 
likely, and students had little ability to 
"take a reactive stance" against ob- 
stacles. Educators found dropouts often 
unreachable for phone follow-up, or the 
teacher didn't have time to call drop- 
outs. Follow-up takes time, and there is 
no consistent set of strategics for deal- 
ing with it. 

Perceptions about the learning pro- 
gram: Students can drop out without 
feeling bad about themselves. Among 
teachers there was no unified percep- 
tion of students' leaving the program. 
The conclusion is that departure should 
not necessarily be viewed as failure but 
rather as a hiatus. 

The study provided a number of rec- 
ommendations to help increase student 
retention, including that programs 
should: 1) form a retention policy; 2) 
provide program flexibility; 3) provide 
retention information in staff training 
(acknowledge it, address it quickly, pro- 
vide strategics); 4) provide independent 
learning materials for students who 
come and go ; 5) conduct further reten- 
tion research. 

Comments: A summary of Endings 
would have been helpful in this :cport; 
instead, all findings were embedded 
within each section (though very well 
organized). 

Despite the small sample, this is a 
valuable and rare study on retention in 
that it analyzes qualitative rather than 
^ "uantitativc data,- students arc consid- 
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ered as individuals rather than generally 
staged against a potentially faulty hy- 
pothesis. Indeed, generalizations are not 
drawn for a situation that may well be 
individual in nature. The study is 
thoughtfully designed and data is thor- 
oughly analyzed from all angles. 
Correlations/cross-references: This 
study notes that other retention re- 
search which "concludes that a mis- 
match between student expectations 
and a teacher or tutor's educational ap- 
proach can lead to poor retention ... ap- 
pears to be a reductionist explanation 
based on the data from this study." 
Contact information: 
Alisa Belzer 

University of Pennsylvania 
Graduate School of Education 
3700 Walnut St. 
Philadelphia, PA 19104-6216 
For copy of full report: 

PA State Literacy Resource Centers 



Retaining Reluctant Learners in ABE 
Through the Student Intake Period 

PA Project #98-3036, in ERIC but ED# 
not available at press time 
Date: 1993 
State: Pennsylvania 
Contractor: Pcnn State University, 
Center for Continuing and Graduate 
Education, Monroeville, PA, in coop- 
eration with The Institute for the 
Study of Adult Literacy, Pcnn State 
University 
Purpose: Continuing a line of earlier 
353-funded projects investigating resis- 
tance to participation in ABE and reluc- 
tance to stay in ABE, to learn if "reluc- 
tant learners" can be retained through 
1) program structural accommodation 
and 2) more effective teacher/counselor 
intervention. 

Procedure: Four groups of five students 
each were formed. Group 1, the control 
group, received no "treatment" as per 
the study,- these students were simply 
referred to regular classes and records 
were kept as to how long they stayed in 
the program. Group 2 was treated 
through a "team approach," referred to 
regular classes but with a counselor- 
teacher team strategy affording students 
more individual attention. Group 3 was 
treated through a "smnll-group ap- 
proach"; they were placed .no existing 
small learning groups of five to six stu- 
dents each; they were observed as to 
whether more peer-group interaction 
would make a difference in retention. 
Group 4 was treated with a "onc-on- 
onc" approach; these basic literacy stu- 



dents were referred to one-on-one tutor- 
ing and observed as to whether "more 
complete teacher attention" would 
make a difference. 

An additional component of this 
study attempted to determine if differ- 
ing learning styles had an impact on re- 
tention. Using two instruments, includ- 
ing the Learning Style Assessment Scale 
developed by Dr. Daniele Flanncry of 
Pcnn State Harrisburg, some learning- 
style data was gathered on all the par- 
ticipating students. 

Summary of findings: The small-group 
approach appeared to be the most prom- 
ising in improving retention: three of 
five students successfully completed 
the ABE program. The onc-on-onc ap- 
proach retained two of five. The team 
approach retained one of five. The con- 
trol group retained no students to pro- 
gram completion. 

The study suggested that it would be 
helpful to identify reluctant learners at 
intake and refer them to alternative pro- 
gram choices. 

Also, the study discovered a correla- 
tion between high field dependence and 
high global learning style among drop- 
outs. 

Comments: The report concedes that 
the study would benefit by replication 
using a larger sample. Indeed, the 
sample was possibly too small and its 
composition too homogeneous to ren- 
der a valid correlation between instruc- 
tional method and retention rate. Even 
ten students in each type of group, as 
the study had anticipated having, is 
probably insufficient. 

The term reluctant learner is defined 
only in terms of the characteristics of 
adult student dropouts, as derived from 
the related earlier Pcnn State studies on 
retention. 

The report includes extensive statis- 
tical analysis, though not as densely so 
as in the earlier studies' reports. 
Correlations/cross-references: Three 
earlier Quiglcy studies (only those un- 
der 353 grants) are profiled above. Re- 
lated studies arc cited in this study's 
report, including the Iowa studies ( 1 989, 
1991) profiled in this section. 
Contact information: 

Dr. B. Allan Quiglcy 

Associate Professor and Regional 

Dircct( ■*, Adult Education 

Pcnn State University 

Center for Cont. and Graduate Ed. 

4518 Northern Pike 

Monroeville, PA 15146 
For copy of full report: 

PA State Literacy Resource Centers 
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Section Four 

Surveys and Evaluations 



Credibility and Acceptability 

of Pennsylvania Schools and College 

Toward the GED Diploma 

PA Project #98-9008 

Date: 1989 

State: Pennsylvania 

Contractor: Adult Education Linkage 

Services, Troy, PA 
Purpose: To survey postsecondary insti- 
tutions in Pennsylvania to determine 
admissions policies and procedures and 
admissions officers 7 awareness of the 
General Educational Development test 
and GED graduates. 
Procedure: The Pennsylvania Higher Edu- 
cation Assistance Agency provided a 
mailing list of all 344 of its approved 
postsecondary institutions in the state. A 
survey instrument was designed and 
mailed to admissions officers at all 344 
institutions, including branch campuses. 
A second mailing of the same survey pro- 
vided a total of 240 forms returned, or 
71 % response. Returns were categorized 
according to type of institution (four- year 
public, four- year private, two-year public, 
two-year private, business schools, nurs- 
ing and health-care schools, and trade/ 
technical schools). Response rate ranged 
from a low of 50% from two-year public 
institutions to a high of 91% from nurs- 
ing and health-care schools. 

The survey was divided into three 
sections. Part 1 consisted of 20 ques- 
tions designed to determine the institu- 
tion's policies and procedures in pro- 
cessing applications for admission. Part 
2 was desig .ed to measure admissions 
officers' knowledge of the GED test it- 
self. Part 3 posed five general questions 
to detei mine the attitudes of admis- 
sions officers and their institutions to- 
ward GED graduates and the GED test. 
Summary of findings: The vast major- 
ity (82%) of institutions reported hav- 
ing GED graduates enrolled, and 61% 
of admissions officers considered the 
GED diploma to be equivalent to a regu- 
lar high school diploma; 61% said the 
same of a GED credential (without an 
accompanying school diploma). How- 
ever, 64% preferred admitting appli- 
cants with a regular diploma and 60% 
£l'"-ired additional substantiating data 
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from GED graduates. In general, how- 
ever, admissions policies were the same 
for all applicants, regardless of type of 
diploma, in 64% of institutions. 

Respondents were more evenly split 
on the question of whether GED gradu- 
ates arc more able to handle 
postsecondary work because of their 
maturity: 32% yes, 40% no, and 28% 
not sure. In a related question, whether 
GED graduates require more remedial 
help than others, a similar split 
emerged: 39% yes, 35% no, and 29% 
not sure. 

The most striking aspect of the sur- 
vey response was admissions officers' 
lack of knowledge of the GED test in 
Part 2 of the survey. In answer to every 
question, a range of 39% to 74% were 
unsure of the GED's subject content. 

Part 3 revealed that 56% of institu- 
tions set minimum acceptable GED 
scores for admission. Indeed, 59% of the 
institutions offer GED preparation 
classes. Also, GED graduates were only 
half as likely to need financial assis- 
tance than others. Responses were fairly 
evenly split in answer to whether ad- 
missions officers perceive GED gradu- 
ates as coming from lower socioeco- 
nomic groups. 

Comments: This was an informative 
study, if only to point out the need to 
disseminate more information to 
postsecondary admissions officers. 
Follow-up: The project applied for and 
received additional funds to produce 
awareness brochures for postsecondary 
institutions and employers. 
Contact information: 
David W. Fluke 

Adult Education Linkage Services 
Box 214 
Troy, PA 16947 
717-596-3474 
For copy of full report: 

PA State Literacy Resource Centers 



Summary of Adult Education Certification 
Requirements 

DAEL #SA-901 
Date: 1990 (?) 
State: Arizona 

Contractor: Arizona Staff Develop- 
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ment Consortium 
Purpose: The report for this project, as re- 
ceived from the DAEL Clearinghouse, is 
merely a set of lists and descriptions. No 
other narrative is provided. The presumed 
purpose was to gather information on cer- 
tification requirements for ABE teachers 
in every state as a basis for revising 
Arizona's own requirements. 
Procedure: Data-collection methodol- 
ogy is not described in this report. The 
presumed sources of information are in- 
dividual State adult education offices. 
Summary of findings: States were bro- 
ken down by those: 1) having no state 
certification requirements (24), 2) re- 
quiring a regular teaching certificate 
(13), 3) requiring some adult education 
training and background (11), and 4) cur- 
rently undergoing changes in certifica- 
tion requirements (2). 

States having no certification require- 
ments were Alaska, Colorado, Georgia, 
Hawaii, Idaho, Illinois, Iowa, Kansas, 
Maine, Maryland, Montana, Nebraska, 
New Hampshire, New Mexico, North 
Carolina, North Dakota, Oregon, Penn- 
sylvania, Rhode Island, South Dakota, 
Vermont, Washington, and Wyoming. 
Mississippi requires a bachelor's degree 
but no teaching certification. 

States requiring a regular teaching 
certificate only were Indiana, Kentucky, 
Massachusetts, Michigan, Missouri, 
Nevada, New Jersey, Ohiu, Oklahoma, 
South Carolina, Tennessee, Virginia, 
and Utah. Utah waives the requirement 
in some rural areas. 

States requiring some adult educa- 
tion training background, to varying de- 
grees, were Alabama, Arkansas, Califor- 
nia, Connecticut, Delaware, Louisiana, 
Minnesota, West Virginia, and Wiscon- 
sin, as well as Washington, DC. 

States undergoing changes at the 
time of the report were Arizona and 
New York. 

The remainder of the report describes 
each state's specific requirements. Of 
most interest are those states that had a 
specific adult education training re- 
quirement. Delaware, for example, re- 
quired one of the following: teacher cer- 
tification plus six semester hours of col- 
lege-level coursework in adult educa- 
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tion, six approved inscrvicc credits in 
adult education sponsored by the state 
or the higher education system, or three 
approved adult education credits and 
two years of internship. In Arkansas, an 
individual holding a valid Arkansas 
teaching certificate must additionally 
complete 12 graduate and/or graduate 
semester hours in adult education in 
specified course areas; those without a 
certificate need a bachelor's degree plus 
18 hours. Anyone teaching adult educa- 
tion in Arkansas must also pass the 
National Teachers of English Test of 
Professional Knowledge, and all of these 
requirements must be completed 
within three years of hire. California re- 
quired a Preliminary Designated Sub- 
jects Adult Credential; ESL teachers 
also needed a Supplementary Authori- 
zation, requiring 12 upper-division 
courses. In addition to a teaching cer- 
tificate, Texas required 12 clock hours 
of staff development training annually. 

Idaho, on the other hand, dropped its 
certification requirement altogether 
"because salaries in ABE/ESL positions 
arc so low ... that the requirement 
seemed unreasonable." Pennsylvania 
had no certification requirement; how- 
ever, "ABE teachers arc encouraged to 
be certified in some areas of education." 

These findings, along with public 
hearings, determined that certification 
requirements for teachers of adult edu- 
cation in Arizona should be reviewed. 
As a result, the Arizona Adult Educa- 
tion Committee was successful in 
changing the requirement from a six- 
year to a one-year renewable certificate. 
Comments: The perennial questions 
are: 1) whether adult education teach- 
ers should indeed be certified teachers, 
2) whether there should be a specific 
adult education certification, and 3) 
why such wildly variable certification 
requirements exist among states. De- 
spite the state-by-statc requirements 
now in pxacc, the certification issue re- 
mains unresolved nationally. 
Correlations/cross-references: The cer- 
tification requirements as listed here 
were taken in part from the "State Pro- 
files Report" component of "Study of 
ABE/ESL Instructor Training Ap- 
proaches: Key Elements of Adult Edu- 
cation Teacher and Volunteer Training 
Programs," profiled on page 30. 

A 1983 Pennsylvania Department of 
Education study called "Feasibility of 
Requiring and Delivering Certification 
for Adult Basic Education" drew two 
general conclusions: 1) examination of 

c literature indicated no clear value 
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of educational certification and 2) the 
issues, findings, and discussions re- 
ported no evidence of philosophy, pur- 
pose, or correlation with teaching per- 
formance and no body of acceptable re- 
search to support a certification require- 
ment. The study concluded that there 
must be a philosophy, clear purpose, 
demonstration of a relationship be- 
tween performance and competence, 
and further research before any certifi- 
cation requirement be put in place. 
Follow-up: For Arizona, the next step 
was to collect additional information 
and write recommendations for changes 
in the specific requirements for renew- 
able certificates. 

Contact information (for current informa- 
tion on Arizona's certification require- 
ment, not necessarily on this report): 
Lisa Rundlc 

Administrative Assistant 
Arizona Department of Education 
1S35 West Jefferson 
Phoenix, AZ 85007 
For copy of full report: 
DAEL Clearinghouse 



An Evaluation of the Statewide Adult Basic 
Education System (SABES) 

Date: 1990-92 (3-ycar, 3-phasc project) 
State: Massachusetts 
Contractor: Center for Resource Man- 
agement, South Hampton, NH 
Purpose: To design, implement, and re- 
port findings of a long-term evaluation 
of the state ABE system's accomplish- 
ments, staff, activities, resources, and 
impact. 

Procedure: In Massachusetts, the State- 
wide Adult Basic Education System 
(SABES), formed in 1990, is a "support 
system to lead and implement program 
and staff development activities aimed 
at improving the quality and impact of 
ABE services." SABES encompasses five 
Regional Support Centers, a Central Re- 
source Center, and ABE programs un- 
der contract with the Massachusetts 
Department of Education. Following an 
extensive study-design phase, this 
evaluation study interviewed SABES 
staff, reviewed SABES documents, sur- 
veyed ABE program directors and prac- 
titioners, and developed case studies on 
three ABE programs representing "vari- 
ous features and contexts. ' 
Summary of findings: An extensive re- 
port details findings of the various as- 
pects of the project. It is difficult to 
summarize all the findings in this lim- 
ited space; however, several general 
conclusions bear mention: 
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• "SABES is an extremely important 
and valuable part of the ABE system in 
Massachusetts; indeed, it has the poten- 
tial to become the infrastructure that 
makes this traditionally fragmented and 
isolated field a 'system' at all." Accom- 
plishments to date were considered im- 
pressive, particularly in light of increas- 
ingly tight budget constraints. The sys- 
tem should be continued 

• Staff development efforts were exem- 
plary and should be expanded. 

• Program development efforts, though 
not fully developed, were providing a 
sound model and should continue. 

• SABES-supportcd local research and 
design efforts were gaining clarity; how- 
ever, limited resources called for care- 
ful prioritizing and linkage with other 
SABES components. 

• SABES technical assistance services 
(financial, administrative, and material) 
were valuable and should be expanded. 
Comments: The extensive detail of the 
projects' final reports and executive 
summaries all lead to the bottom-line 
recommendation that SABES was oper- 
ating on the right course and should he 
continued and expanded. Contained 
within each section of the reports arc a 
plethora of observations and insights of 
value to any overseeing organization 
attempting to coordinate ABE services, 
particularly if they would be interested 
in using SABES as a model. 

Contact information: 
Martha Williams 
SABES Evaluation Consultant 
Center for Resource Management 
2 Highland Rd. 

South Hampton, NH 03827-3607 
603-394-7040 
For copy of full report: 
Bob Bozanjian 

Comm. of Mass. Dept. of Education 
Adult & Community Education 
Learning Services 
350 Main St. 
Maiden, MA 02148 



Evaluating the Use and Impact of Section 
353 Projects 

PA Project #98-2068 

Date: 1992 

State: Pennsylvania 

Contractor: Adult Education Linkage 

Services. Troy, PA 
Purpose; To survey adult educators in 
Pennsylvania to determine 1 ) the extent 
of their awareness of the availability 
and nature of Section 353 projects, prod- 
ucts, and information and 2) the extent 
of adaptation/adoption of Section 353 
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projects conducted in Pennsylvania in 
FY89 and FY90. 

Procedure: A survey instrument was de- 
veloped and mailed to 286 program di- 
rectors and 1,704 persons, mainly pro- 
gram personnel, on the mailing list of 
"What's the Buzz?" (the state adult ba- 
sic and literacy education newsletter). 
Part 1 of the survey, "Project Im^jct 
Study," asked about general awareness 
of, use and adoption/adaptation of, and 
participation in 353 projects. Part 2, an- 
other "Project Impact Study," asked 
about the awareness and usefulness of 
AdvancE (the state literacy resource 
center) and two newsletters funded un- 
der Section 353. Part 3, "Project Use 
Survey," had two pages, one for those 
who had used Section 353 projects and 
one for those who had not. 
Summary of findings: Among program 
personnel, 58% of respondents reported 
familiarity with purposes for 353 
projects, 44% said they had used infor- 
mation from projects, 34% had partici- 
pated in a project, 62% had adapted 
projects, and 18% had adopted projects. 
General impact of 353 projects was 
deemed "very successful" by 33%, 
"somewhat successful" by 65%, and 
"mediocre" by 2%. No one indicated 
"not successful." 

Among program directors, 89% of re- 
spondents reported familiarity with 
purposes for 353 projects and 69% said 
they had used information from 
projects. Program directors were not 
asked some of the other questions but 
were asked questions on administration 
relative to 353 projects. Though 80% of 
program directors said they had brought 
Section 353 information to the atten- 
tion of their staff, only 39% of program 
personnel recalled such activity. 

Though projects, such as staff devel- 
opment workshops, were considered ef- 
fective, a large number of ABLE practi- 
tioners were not being reached, and 
many of those who were being reached 
were not using information or products 
effectively. 

Many more specific survey results 
and verbatim comments are available in 
the project's final report. 
Comments: Unrcturncd survey forms 
could indicate a highcr-than-reported 
level of disinterest in 353 projects. 
Correlations/cross-references: The sur- 
vey was based on iwo publications of 
the U.S. Department of Education, Di- 
vision of Adult Education: "Evaluating 
the Implementation and Impact of Sec- 
tion 353 Projects" (1988) and "Effective 
^~Mon 353 State Administration: A 
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Self-Study Guide" (1988), as well as a 
1988 Florida study, "Impact of 310 
Projects, 1980-84." The director of this 
project was unable to secure a copy of 
the Florida study, presumed to be the 
only prior definitive study in this area. 
Contact information (for those who 
have already read the final report): 
David W. Fluke 

Adult Education Linkage Services 
Box 214 
Troy, PA 16947 
717-596-3474 
For copy of full report: 

PA State Literacy Resource Centers 



310-353 Program Impact Assessment 
Report 

Date: 1992 
State: Florida 

Contractor: Center for Instructional 
Development and Services, Florida 
State University 
Purpose: To determine how well 310/ 
353 projects conducted 1984-90 in 
Florida have increased the knowledge of 
adult educators in methods, techniques, 
and materials available for adult educa- 
tion; to what degree these projects' ex- 
emplary programs and models have 
helped promote more effective adult 
education practices; how project design, 
implementation, dissemination proce- 
dures, and other factors promote or in- 
hibit the success of projects; and what 
the scope of the 3 1 0/353 projects funded 
from year to year have been. 
Procedure: The study included a litera- 
ture review; a telephone survey of key 
adult educators; a written survey of 
adult education administrators, teach- 
ers, project directors, literacy center di- 
rectors, and university faculty; a review 
of 310/353 project and materials; and 
the creation of a database of informa- 
tion on 310/353 projects funded during 
1984-90. 

Summary of findings: Literacy is the 
most pressing need of Florida's adult 
education population; teacher training 
and staff development arc also "ex- 
tremely important." No targeted cat- 
egories or populations have been dispro- 
portionately or over funded; a tremen- 
dous need continues to exist in all ar- 
eas, but ESL, at-risk youth, handicapped 
adults, and rural residents should re- 
ceive greater funding. 

Presentations and workshops at the 
Adult and Community Educators of 
Florida Conference and the Florida Lit- 
eracy Conference arc the most valuable 
310/353 dissemination sources. Half of 
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respondents would make no changes to 
the dissemination process; others sug- 
gested adopting dissemination criteria, 
a statewide clearinghouse, and project 
evaluations. Directors share informa- 
tion on 310/353 projects most often 
through the mail in response to direct 
requests or assumed interest in a spe- 
cific project. 

Most interviewees were satisfied 
with the. present application/funding 
process. Several suggested providing 
feedback on rejected proposals and 
awarding grants on time. Opinion was 
divided on whether or not the Bureau of 
Adult and Community Education 
(BACE) was doing 2 good job monitor- 
ing projects. 

• Leadership, effective managemenv, 
adequate funding, and project planning 
were identified as crucial to success. 
Setting and monitoring goals was the 
most frequently cited means of evalu- 
ating projects. 

A majority of respondents had par- 
ticipated in some way in one or more 
310/353 projects. Materials that support 
ABE, literacy, and GED were viewed as 
most relevant; more teachers than ad- 
ministrators ranked teacher-training 
materials as relevant. Only one-third of 
respondents had ever adopted an exem- 
plary project. Nearly 95% felt that 3 10/ 
353 had contributed to the successful 
execution of adult education in their 
county or organization. 

Of 101 projects funded during 1984- 
90, 29 were evaluated on the basis of 
systematic design and development, as 
well as outcomes. The most outstand- 
ing criticism was that only six projects 
included an evaluation of their process, 
and many of the materials submitted to 
BACE did not include thorough docu 
mentation of needs assessments, dis- 
semination activities, and problems en- 
countered. 

The study concluded that the grant 
program should continue to focus on its 
existing priorities rather than expand to 
encompass new ones; however, staff de- 
velopment should receive greater fund- 
ing. 

Comments: Much information was de- 
rived from this study, though little in- 
depth criticism and recommendations 
for improvement of the 353 process are 
documented. 
Contact information: 

Florida Department of Education 
Division of Vocational, Adult, and 
Community Education 
1244 Florida Education Center 
Tallahassee, FL 32399-0400 
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904-488-8201 
For copy of full report, including Execu- 
tive Summary and Directory of Projects: 

Florida Department of Education 



What Has Happened to Iowa's GED 
Graduates? A Two-, Five-, and Ten-Year 
Follow-Up Study 

ERIC #ED344047 
Date: 1992 
State: Iowa 

Contractor: Iowa State Department of 

Education 
Purpose: To conduct a longitudinal 
study to determine the short-term (two- 
year), intermediate-term (five-year), and 
long-term (ten-year) impact of earning 
a GED and Iowa's high school equiva- 
lency diploma. 

Procedure: Current addresses of Iowa 
GED graduates from 1980, 1985, and 
1988 (2,500 from each year) were lo- 
cated through driver's license numbers, 
which correspond to the identification 
number used on GED Tests applica- 
tions. 

A six-page, 40-item follow-up survey 
was mailed to these individuals, includ- 
ing GED graduates who had partici- 
pated in an ABE program, in the spring 
of 1991. Of the 7,500 forms mailed, 
1,597 were returned, divided roughly 
evenly among the three periods. 
Summary of findings: GED graduates 
had significant gains in employment be- 
tween the time just prior to passing the 
GED and 1990, hours worked per week, 
job skill level, job satisfaction, personal 
income, reduction in welfare, job qual- 
ity, property acquisition, and personal 
savings. 

Gains in hours worked were greatest 
between two and five years after the 
GED and leveled off between five and 
ten years. Gains in job skills, job satis- 
faction, personal income, savings, indi- 
ces of job quality, and economic benefits 
increased steadily over time. 

The overwhelming majority of GED 
graduates who had been enrolled in an 
ABE program reported that attending 
classes had helped them acquire the req- 
uisite knowledge to pass the GED. 

Because the researchers acknowl- 
edged a possible response bias in respect 
to factors such as gender, income, age, 
and educational level, they conducted a 
second analysis on findings. No bias 
was found except in age, since younger 
subjects were underrepresentcd in the 
survey. 

Comments: As the final report ac- 
knowledges, the study had no control 



group of traditional high school gradu- 
ates or dropouts from traditional high 
school programs against which to com- 
pare achievement levels. 

The study assumed that subjects 
were responding truthfully to the sur- 
vey questions. 

An array of appendices consume half 
of the final report. These include refer- 
ences, information on the instruments 
employed in the study, qualitative com- 
ments, and descriptive statistics. 

At the front of the report are selected 
subjective comments from study par- 
ticipants on the impact of the GED on 
their lives. Many of these comments 
would be useful in ABE publicity cam- 
paigns. 

Contact information: 
Dr. John Hartwig 
Division of Community Colleges 
Iowa Department of Education 
Grimes State Office Building 
Dcs Moines, I A 50319-0146 
515-281-3636 

For copy of full report: 
ERIC 



The Year in Review, Volume 1 : 1 991 -92, 
Teachers Learning: An Evaluation of ABE 
Staff Development in Virginia 

Date: 1992 
State: Virginia 

Contractor: Virginia Adult Educators 

Research Network 
Purpose: To identify the extent to which 
current ABE staff development mecha- 
nisms in Virginia (a centralized resource 
center, a regionalized training program, 
a centralized annual conference, and a 
statewide newsletter) meet teachers' 
needs for skill and knowledge develop- 
ment. 

Methodology: The project used prima- 
rily qualitative methods. First, it as- 
sembled an advisory group to provide 
suggestions for making the project prac- 
tical and relevant. Data was collected 
through interviews of 50 individuals at 
two summer institutes; a survey re- 
turned by 72 teachers, tutors, and ad- 
ministrators; and focus-group inter- 
views in six areas. Interview data was 
transcribed onto computer disk and 
printed out onto nearly 1,000 pages. In- 
formation was coded into categories 
such as "types of learning activities 
mentioned, characteristics of good 
workshops, descriptions of how teach- 
ers say they have changed what they do 
and less related topics like the desire for 
teacher benefits, descriptions of teach- 
ing techniques, etc." After intense data 



manipulation, themes emerged, which 
were compared and analyzed manually. 
Summary of findings: A number of key 
findings are detailed in the final report, 
including many direct quotes. Among 
the main points (here paraphrased or 
quoted directly): 

At the local level: 1 ) Teachers and 
students create a context for learning. 
2) Teachers who have experience in pub- 
lic school classrooms say they transfer 
this knowledge to their work in adult 
classrooms. 3) Some teachers report 
that they learn from their students. 4) 
Some teachers learn from other people 
in their classrooms. 5) Many teachers 
and volunteers apply their personal re- 
lationships and prior personal experi- 
ences. 6) A few teachers turn to the pro- 
fessional literature for help \n develop- 
ing their teaching skills. 7) Local pro- 
grams provide access to learning re- 
sources. 8) Almost all teachers call on 
local administrators for information but 
not instructional assistance. 9) Admin- 
istrators sec themselves as teachers sec 
them: as responsible for creating a cli- 
mate, etc. 10) Almost all teachers recall 
instances where observing and talking 
with other teachers gave them insights 
into solutions for their own classroom 
problems. 1 1 ) Teachers talk about the 
value of their work based on their own 
experiences with students and contrast 
this with their perceived low status as 
ABE teachers. 12) Cultural differences 
sometimes interfere with communica- 
tion between teachers and students. 

At the regional level: 1 ) Teachers 
generally describe "cluster training" (re- 
gional workshops) as interesting and 
practical. 2) The most frequent criti- 
cism of cluster training is that some pre- 
senters do not practice "good adult edu- 
cation" (they lecture too much without 
group participation). 3) Teachers would 
like a greater role in cluster training. 4) 
Cluster training is organized on a tradi- 
tional "expert training model." 

At the state level: 1) Section 353 
projects provide resources for staff de- 
velopment. 2) Teachers need to feel a 
part of the statewide community of 
adult education. 3) Many teachers want 
to be part of a more coherent system and 
for their own learning to be part of a 
coherent plan. 4) The state workshop 
activities that teachers and administra- 
tors find useful reflect their own spe- 
cific programmatic situations. 5) Satis- 
faction with the resource center appears 
to reflect teachers' geographic location, 
area of teaching, resources available at 
their sites, and years of experience. 
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Comments: Because the survey instru- 
ment and interviews were based on a 
broad survey of the existing literature 
on staff development, they could be 
adapted by other states interested in as- 
sessing staff development, perhaps lo- 
calizing terminology here and there. 

The report provides not only a reveal- 
ing and informative look at adult lit- 
eracy staff development in one state but 
also descriptions of various staff devel- 
opment philosophies and models in 
general. 

Correlations/cross-references: An ex- 
tensive bibliography provides a body of 
literature related to staff development. 
Contact information: 
Suzanne Cockley 

Virginia Adult Educators Research 

Network 

290 Mill St. 

Dayton, VA 22821 

703-879-2833 

or 

Dr. Hanna Arlene Fingerct 
Literacy South 
Snow Building, Room 202 
331 West Main St. 
Durham, NC 27701 
919-682-8108 
For copy of full report: 

Virginia Adult Educators Research 
Network 

Address above. Cost: $5.00 



Pennsylvania Adult Literacy Survey: 
Interim Reports 

PA Project #98-2069 
Date: 1992, 1993 

State: Pennsylvania (similar projects in 
California, Florida, Illinois, Indiana, 
Iowa, Louisiana, New Jersey, New 
York, Ohio, Texas, and Washington) 
Contractor: Educational Testing Ser- 
vice, Princeton, NJ 
Purpose: To conduct a multiycar state 
survey of literacy among adults aged 16 
through 64, based on the concurrent 
National Adult Literacy Survey (NALS) 
being conducted for Educational Test- 
ing Service (ETS) by its subcontractor, 
Wcstat, Inc. The goals were to 1) draw 
the sample, 2) prepare survey materials, 
3) train interviewers, 4) collect data, S) 
score and enter data, 6) apply population 
weights, 7) scale and analyze data, 8) re- 
port findings, and 9) coordinate manage- 
ment of the survey. 

Procedure: Under rigid quality-control 
standards, the project prepared a list of 
homes to visit in Pennsylvania (along 
with 11 other participating states), 
fo~~d on the 1990 Census. The literacy 
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survey instrument developed for the 
NALS was supplemented with five 
state-developed, state-specific multiple- 
choice questions. Interviewers and dis- 
trict supervisors were recruited and 
trained. Hour-long interviews in 1,000 
households were conducted between 
February and June 1992. As ETS re- 
ceived materials from the field, trained 
scorers reviewed and scored responses; 
20% of the interviews were rcscorcd to 
assure 96% score reliability. 

Data collection field work was com- 
pleted in August, 1992. Scoring and data 
entry of Pennsylvania cases followed 
the same procedure as the NALS cases. 
This was completed by November 1 992. 
Cases from the PALS were merged with 
cases collected in Pennsylvania by the 
NALS by February 1993. During April 
and May 1993 data was scaled. 
Summary of findings: According to 
plan, findings were incomplete pending 
final analysis, due after the deadline for 
this publication. 

Comments: These arc primarily compi- 
lations of progress reports released to 
state survey leaders during the multi- 
year project, rather than final reports in 
standard Pennsylvania format. 

Pennsylvania-specific questions ap- 
pear less comprehensive than those 
listed for some other participating 
states. 

The first year's report frequently re- 
fers to funding limitations. 
Correlations/cross-references: This 
study was an integral component of the 
NALS, whose working definition of lit- 
eracy — specifically prose, document, 
and quantitative literacy tasks — ap- 
plied to the state surveys. 
Follow-up: Pennsylvania data analysis 
was to be completed by December 31, 
1993 and a final report prepared. 
Contact information: 

Douglas Rhodes 

Field Director 

National Adult Literacy Survey 
Educational Testing Service 
Roscdale and Carter Roads 
Princeton, NJ 08541 
609-734-5499 

800-223-0267 (indefinitely) 
For copy of full report: 

PA State Literacy Resource Centers 



Assessing the Need, Acceptability and 
Resources for Adult Literacy Staff Develop- 
ment through Distance Education in Rural 
PA Recommended Models 

PA Project #98-3001 
Date: 1993 
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State: Pennsylvania 
Contractor: Penn State University 
Purpose: In rural Pennsylvania, to 1 ) de- 
termine staff attitudes toward various in- 
teractive distance education technologies 
for purposes of staff development, 2) pro- 
vide an overview of the equipment acces- 
sible to staff, and 3) review the literature 
on distance-education staff development 
in North America. 

Procedure: A random selection of 25% 
of adult literacy teachers and tutors in 
rural areas derived from regional staff 
development center mailing lists, along 
with all corresponding program admin- 
istrators, were surveyed. The instru- 
ment design was based on the literature 
review. Of 306 surveys mailed, 45% 
were returned and 40% (N=122) were 
usable, i.e. contained answers to an ad- 
equate number of questions. 
Summary of findings: Fifty percent of 
administrators, 57% of paid teachers/ 
staff, and 44% of volunteer tutors con- 
sidered staff development important, 
though 57%, 54%, and 78%, respec- 
tively, said they had already received 
adequate training and 61%, 61%, and 
48% felt they needed more staff devel- 
opment. Willing to travel one-half hour 
to attend staff development programs 
were 86% of administrators, 77% of 
teachers/staff, and 72% of volunteers. 
(This is not clearly stated in the report; 
figures arc taken from Table 1). 

The most available equipment for 
distance education delivery were video 
cameras and VCRs (70% among admin- 
istrators and teachers/staff); however, 
volunteers seemed mostly unaware of 
the existence of such resources. 

Regarding use of various media for 
staff development, administrators were 
slightly more comfortable with com- 
puters than video, while teachers/staff 
were slightly more comfortable with 
video than computers. Volunteers were 
much less comfortable with computers 
than with video. 

The project recommended a demon- 
stration model employing a "phase-in 
process" of interactive distance educa- 
tion, starting with audio, the medium 
considered the most comfortable, and 
later computer and video. Three dis- 
tance-education staff development sce- 
narios arc offered for Pennsylvania. 
Comments: This is a rare look at adult 
educators' attitudes on distance educa- 
tion, as well as a survey of current de- 
livery systems. 

Correlations/cross-references: A substan- 
tial section of the final report is devoted 
to a description of distance-education dc- 
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livery models in several other states and 
Canada, along with a bibliography, 
roliow-up: At this writing it was too 
early to report whether the recommen- 
dations were implemented. 
Contact information: 

Dr. Danieie D. Flannery 

Assistant Professor and Coordinator 

of Adult Education D.Ed. Program 

Penn State - Harrisburg 

777 W. Harrisburg Pike 

Middletown, PA 17057 

717-948-6319 

or 

Dr. B. Allan Quigley 
Associate Professor and Regional 
Dir. Adult Education M.Ed. Prog. 
Penn State University - Monroeville 
4518 Northern Pike 
Monroeville, PA 15146 
For copy of full report: 

PA State Literacy Resource Centers 

U.S. Dept. of Education Evaluation Projects 

In addition to the state-adminis- 
tered Section 353 grants, the U.S. De- 
partment of Education directly funds 
research projects under Section 383 of 
the Adult Education Act, which pro- 
vides for evaluation of activities con- 
ducted under the Act, through the Re- 
search Information Network. 

What follows are reviews of three re- 
cent Section 383-funded studies which 
would be of interest to a broad audi- 
ence involved in adult basic and lit- 
eracy education. 



Study of ABE/ESL Instructor Training 
Approaches: Key Elements of Adult 
Education Teacher and Volunteer Training 
Programs and State Profiles Report 

Project #VN90001001, DAEL: #SD-10 
(Key Elements) and #R-4 (State Pro- 
files Report), ERIC #ED344056 and 
#ED338605 (State Profiles Report) 

Date: 1991 

Contractor: Pelavin Associates, Inc., 
Washington, DC, with San Francisco 
State University and Adult Learning 
Resource Center 
Purpose: To identify elements of effec- 
tive ABE/ESL staff development prac- 
tices through a research review and site 
visits to nine staff development pro- 
grams identified as providing effective 
training for adult education teachers 
and volunteer instructors. 
Procedure: A survey of the literature pro- 
duced a framework for examining nine 
adult education programs to gather infor- 



mation on their staff development prac- 



tices. The researchers visited programs in 
Washington, Delaware, California, Min- 
nesota, Florida, California, New York, 
New Jersey, and Massachusetts. Four ele- 
ments associated with delivery of train- 
ing services were examined: 1) experi- 
enced and dedicated training administra- 
tor and staff, 2) decentralized training ser- 
vices, 3) systematic follow-up of training^ 
and 4) evaluation procedures. Five ele- 
ments associated with the content of ef- 
fective training services were examined: 
1 ) providing training services responsive 
to the needs of teachers and volunteer in- 
structors, 2) involving participants in the 
learning process, 3) modeling appropriate 
instruction, 4) placing learning within a 
theoretical framework, and 5) providing 
training topics appropriate for adult edu- 
cation teachers and volunteer instructors. 
Only state-administered efforts were ex- 
amined, not local inservicc plans. 

The State Profiles Report component 
of this study examined ABE and ESL 
staff training activities through Office 
of Vocational and Adult Education files, 
state reports and descriptions requested 
from state directors of adult education 
and state staff responsible for Section 
353-funded activities, and reports and 
descriptions of training activities re- 
quested from directors of training pro- 
grams. In this separate volume, data is 
presented in a consistent, statc-by-statc 
format, including number of ABE and 
ESL participants in FY1989, federal/ 
state/local expenditures for adult edu- 
cation (FY1989), number of adult edu- 
cation teachers (FY1989) and volunteer 
instructors (FY1990), state certification 
requirements, a list of training activi- 
ties conducted during FY1990, and de- 
scriptions of these activities, including 
the number of people in attendance and 
the content of the training. Data from 
Florida was unavailable, but staff devel- 
opment facts on the other 49 states and 
the District of Columbia are listed. 
Summary of findings: Of the four ele- 
ments of training-services delivery ex- 
amined, the first two— "experienced, 
dedicated training staff and decentral- 
ized training services — were central el- 
ements at most study sites. The other 
two elements — systematic follow-up 
and evaluation of training services — 
were less likely to be incorporated 
within the delivery of training services, 
though frequently cited in research lit- 
erature." Limited financial resources 
and the part-time nature of the adult 
education delivery system are cited as 
reasons for these shortcomings. 

Anecdotal data was gathered on the 



content of training services. The 
project's final report provides this infor- 
mation in full detail. In general, train- 
ing in response to teachers' and volun- 
teer instructors' needs included the use 
of teacher surveys, workshop evalua- 
tions, training staff recommendations, 
and informal needs assessments. In- 
volving the participant in the learning 
process included use of a practice-ori- 
ented approach, learner-centered strat- 
egies, peer coaching, teacher-action re- 
search, and study circles. Modeling ap- 
propriate instruction included the use 
of videos primarily. Study sites placing 
learning within a theoretical frame- 
work introduced research literature as 
a context for subject matter presented 
or wove theory into the training session 
to provide a rationale for applying cer- 
tain teaching techniques. Providing 
training in appropriate content areas in- 
cluded both subject-matter and peda- 
gogical content. 

Comments: The final report provides a 
basic theoretical background for effec- 
tive staff development, but the many 
examples of practices within specific 
programs across the country arc what 
breathe life into this framework. The 
omission of local staff development ef- 
forts leaves many questions, though its 
absence is understandable within the 
limited scope of this project. At the very 
least, however, this project provides 
model principles for designing adult 
education staff development programs. 
Correlations/cross-references: Note 
that the State Profiles Report is a sepa- 
rate document. This and the Key Ele- 
ments component were completed at 
different times during 1991, and both 
ERIC and the DAEL Clearinghouse ship 
them separately. 
Contact information: 

Mark A. Kutner 

Pelavin Associates, Inc. 

2030 M Street, NW, Suite 800 

Washington, DC 20036 

or 

Office of Vocational and Adult Ed. 
U.S. Department of Education 
Washington, DC 20002 
For copy of full report: 

ERIC or DAEL Clearinghouse 



Study of Federal Funding Sources and 
Services for Adult Education 

Project #LC89058001, DAEL #R-8, 

ERIC #ED355398 
Date: 1992 

Contractor: COSMOS Corporation, 
Washington, DC 
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Purpose: Under contract with the U.S. 
Department of Education, Office of 
Policy and Planning, the researchers 
were authorized to collect and synthe- 
size available information about all 
adult education programs within the 
Federal government that support lit- 
eracy, basic skills, English as a second 
language, or adult secondary education. 
This was Phase 1 of a two-phase project 
aimed at improving coordination 
among Federal, State, and local adult 
education programs. 
Procedure: Through face-to-facc and tele- 
phone interviews, researchers gathered 
information from representatives of some 
85 programs in 12 separate Federal agen- 
cies regarding their funding of adult edu- 
cation activities and types of services pro- 
vided. Potential programs for study were 
categorized as: 1 ) primary, in which adult 
education is the priority objective of the 
authorizing legislation,- 2) secondary, in 
which adult education is an approved ac- 
tivity within the authorizing legislation,- 
or 3) indirect, in which there is no explicit 
legislative mandate but a policy decision 
is required to fund adult education activi- 
ties. 

Summary of findings: The study identi- 
fied 85 programs in 12 Federal agencies 
that authorize or support adult educa- 
tion activities. Of these, 27 were catego- 
rized as primary, 27 as secondary, and 
31 as indirect. The agencies with the 
largest numbers of adult education pro- 
grams were the Department of Educa- 
tion with 38, the Department of Health 
and Human Services with 13, and the 
Department of Labor with seven. The 
other Federal agencies were ACTION 
(VISTA), Appalachian Regional Com- 
mission, Department of Agriculture, 
Department of Defense, Department of 
Housing and Urban Development, De- 
partment of the Interior, Department of 
Justice, and Department of Veterans 
Affairs. (The twelfth agency, the Ten- 
nessee Valley Authori'.y, was elimi- 
nated from the study because funds for 
adult education services could not be 
documented.) 

Figures compiled frjm 31 of the pro- 
grams indicated that $247,090,059 was 
spent on adult education in FY1989, most 
through the Department of Education un- 
der the Adult Education Act. The total ex- 
penditure is considered a low estimate be- 
cause many Federal programs authorizing 
multiple activities do not require separate 
reporting for each type of funding, includ- 
ing adult education activities. Even 
within the Department of Education, the 
^~*-*c docs not include funds from the Job 
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Training Partnership Act, Job Opportuni- 
ties and Basic Skills Program, or the State 
Legalization Impact Assistance Grants. 

Support for adult education is con- 
centrated on providing direct educa- 
tional services in basic skills and lit- 
eracy. Activities such as research, dis- 
semination, and staff training represent 
only about 4% of the monies accounted 
for in FY1989. 

Two barriers to collecting information 
for this study were identified: 1) lack of 
complete data collected from State and lo- 
cal programs and 2) paper filing systems 
which were difficult to access. The 
project recommended improved data-re- 
porting and -storage systems. 
Comments: This study represents im- 
portant groundwork for improving co- 
ordination of federally funded adult edu- 
cation activities. All the data that was 
possible to collect is presented clearly, 
program by program, in a 145-page final 
report, plus 78 pages of appendices. 
Correlations/cross-references: Phase 2 
of this project is described below in 
"Patterns of Promise: State and Loc.il 
Strategics for Improving Coordination 
in Adult Education Programs." 
Contact information: 

Judith A. Alamprcse 

June S. Sivilli 

COSMOS Corporation 

Washington, DC 

(No further address detail provided.) 
For copy of full report: 

ERIC or DAEL Clearinghouse 



Patterns of Promise: State and local 
Strategies for Improving Coordination in 
Adult Education Programs 

Project #LC89058001 ; DAEL #R-9, 

ERIC #ED35S398 
Date: 1992 

Contractor: COSMOS Corporation, 

Washington, DC 
Purpose: Under contract with the U.S. 
Department of Education, Office of 
Policy and Planning, the researchers 
were authorized to investigate State and 
local program efforts for delivering co- 
ordinated services in adult education 
and to provide recommendations about 
the need for program coordination and 
facilitation among Federal, State, and 
local levels. This was Phase 2 of a two- 
phase project aimed at improving coor- 
dination among Federal, State, and lo- 
cal adult education programs. 
Procedure: The study examined two as- 
pects of interagency coordination of 
adult education services: 1) structural 
arrangements that facilitate the ways in 
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which State and local policymakers un- 
dertake coordination activities and 2) 
organizational and communication 
strategies used in coordination. Five 
model sites for study (in Georgia, Michi- 
gan, Oregon, New York, and California) 
were selected based on evidence of co- 
ordination of services between 1) the 
State adult education office and at least 
one other state agency and 2) a local 
adult education program and other lo- 
cal programs. The five sites were exam- 
ined using a case-study protocol: two 
days were spent at the State adult edu- 
cation office and one day at the local 
program site, interviewing key person- 
nel, observing interagency meetings, 
and reviewing available documentation 
of coordination efforts. The five cases 
were then cross-analyzed, factors were 
identified that inhibit coordination, and 
steps for promoting interagency coordi- 
nation were recommended. 
Summary of findings: The study found 
three common organizational strategies 
for successful coordination of services: 1) 
development of interagency agreements 
for transferring funds, services, or staff be- 
tween agencies, 2] State-established in- 
centives to encourage interagency coor- 
dination, and 3} State-provided training 
and technical assistance to help local sites 
in coordination activities. 

The programs being examined dem- 
onstrated two common interpersonal 
communication strategics for success- 
ful coordination: 1) mechanisms to pro- 
mote ongoing communication across 
agencies and 2) enhancement of exist- 
ing relationships among staff in cooper- 
ating agencies through new initiatives. 

In addition, new organizational and 
fiscal resources were identified to 
strengthen State and local initiatives. 

The programs examined in this study 
enjoyed several key benefits as a result 
of having coordinated services: 1) en- 
hanced political visibility, 2) expansion 
of State and local agencies' networks, 
and 3) more integrated delivery of edu- 
cation and support services to adult edu- 
cation clients. 

Obstacles to coordination were 1 ) limi- 
tations of Federal regulations and data-re- 
porting requirements (including differing 
definitions of target client groups and 
data-collection elements), 2) staff turn- 
over in agencies and changing priorities, 
and 3) emergence of "turf" issues. 

Three coordination strategies appli- 
cable to other State and local programs 
were: 1) a strong leadership role in fos- 
tering interagency coordination, 2) pro- 
vision of technical assistance to support 
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coordination, and 3) the importance of 
negotiation among organizations. 

The researchers recommended four 
possible options for improvement of 
Federal and State agencies to: 1) con- 
tinue addressing the need for common 
definitions, outcome measures, and 
data-reporting systems; 2) provide tech- 
nical assistance and training services to 
State adult-education, job-training, and 
social-service agency representatives in 
negotiating and carrying out inter- 
agency coordination; 3) continue pro- 
viding State adult education office staff 
with information about methods for 
pooling resources and establishing dem- 
onstration programs to experiment with 
models for integrated service delivery, 
and 4) develop and disseminate infor- 
mation regarding effective practice in 
interagency coordination. 

Recommendations for State adult edu- 
cation officials were to: 1 ) develop incen- 
tives to encourage local programs to work 
collaboratively, 2) provide training and 
technical assistance activities for local 
program staff so they can learn about 
strategies for working with other agencies 
(particularly in workplace and family lit- 
eracy), and 3) disseminate information 
regarding successful practices in coordi- 
nation and develop peer-assistance net- 
works to be used by local staff. 

The final report details all the above 
aspects of the five case studies. 
Comments: Because such a vast array 
of providers delivers adult education 
services, the field has been fertile 
ground for problems such as "duplica- 
tion of services " and "turf wars" for 
many years. Still, many local program 
administrators remain resistant to any 
real efforts at service "linkages," i.e. in- 
teragency coordination. This study is a 
valuable look at successful service co- 
ordination, and plants many soundly 
researched ideas for State adult educa- 
tion offices and local programs to con- 
sider in their own coordination efforts. 
Correlations/cross-references: Phase 1 
of this project, "Study of Federal Fund- 
ing Sources and Services for Adult Edu- 
cation," is described above. 
Contact information: 

Judith A. Alamprcsc 

Nancy Brigham 

June S. Sivilli 

COSMOS Corporation 

Washington, DC 

(No further address detail provided.) 
For copy of full report: 

ERIC or DAEL Clearinghouse 
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The National Adult literacy Survey 

The National Adult Literacy Survey (NALS) was a landmark study completed in 
1993. It is being cited in both professional literature and the popular press for its revela- 
tions on the state of literacy in America near the turn of the millennium. The study was 
funded through various sources, including the U.S. Department of Education, Office of 
Vocational and Adult Education. Because of its relation to the research projects profiled 
in this publication, we provide here a summary of the NALS, from "Report Shows Large 
Number of Adults Have Limited Literacy Skills," by Susan McDonald (Laubach Lit- 
eracy Action's Literacy Advance, Vol. 17, No. 4, 1993), excerpted with permission. 

The recent literacy survey ... is the first major scientific study to provide a picture 
of the abilities of American adults to use printed material to accomplish day-to-day 
tasks. The study found that a very large number of people — 90 million — have "quite 
limited" abilities. 

Released to the public by the U.S. Department of Education on September 8, the 
survey tested people on their ability to perform a variety of tasks "that reflect the types 
of materials and demands they encounter in their daily lives." 

The survey was conducted in three parts: a national survey of 13,600 people; state 
surveys of 1,000 people each in 12 different states; and a survey of 1,100 inmates in 80 
federal and state prisons. 

Participants were asked to perform tasks as simple as locating the time or place of a 
meeting on a form, or as difficult as analyzing long, complex documents and making 
inferences from them. 

The survey tested participants' skills in the areas of prose, document, and quantita- 
tive literacy. It described people as performing at one of five different skills levels in 
each of the three areas, with Level 1 being the lowest skill level and Level 5 the highest. 

Survey participants represented both sexes, all races, and a variety of socioeconomic 
and education levels. More than 21 percent (40 million) of the adults performed at the 
lowest skill level. Some of them could identify a specific piece of information in a short 
news article, or total an entry on a deposit slip. Many could not. Another 25 percent (50 
million) demonstrated higher but still limited skills by testing at Level 2. For instance, 
they could total up the cost of a purchase or find something on a street map. 

When the NALS report applied these findings to the general U.S. population, it 
estimated that about half the adults in the U.S. perform at Skill Levels 1 or 2. This 
indicates that the 90 million Americans who perform at the two lowest skill levels 
would not be able to integrate or synthesize information in any complex way, and 
face "considerable difficulty" with advanced reading of problem-solving tasks. 

Approximately 33 percent of the participants, or about 61 million adults, had Level 
3 skills. They could integrate information from long texts with relative ease and per- 
form more complicated tasks where quantities needed to be inferred from the narrative. 

The report acknowledged that many adults who tested at low levels nonetheless 
live full lives and hold good jobs. Interestingly, many of the participants testing in 
Levels 1 and 2 did not consider themselves "at risk" because of their literacy skills. A 
majority of those in Level 1, and almost all of those in Level 2, described themselves as 
being able to read English "well" or "very well." Still, the study demonstrated striking 
connections between literacy, economic health, and citizenship participation. 

Adults who performed at higher skill levels were more likely to have jobs, work 
more hours, and earn higher vvages. Nearly half of all adults in the two lower skills 
levels were living in poverty. In addition, only one half of the adults performing at Level 
1 had voted in the last five years compared to nearly 90 percent of the highest skills 
adults who had voted. The overall determination of the survey was that people "with 
limited literacy skills arc likely to find it more challenging to pursue their goals." 

The Department of Education will release further reports on selected subgroups 
through June 1994. These include reports from the 12 individual states, and reports 
on prison literacy, literacy and the labor force, literacy and schooling, literacy and 
older adults, English literacy of language minority groups, and literacy and political 
participation. 

For further information on these reports and their release dates, contact the U.S. 
Department of Education, Office of Educational Research and Improvement, 555 
New Jersey Avenue NW, Washington, DC 20208-5641. Call 800/424-1616 or 202/ 
219-1651. A full copy of the NALS report, entitled Adult Literacy in America, is 
available for approximately $16 from the U.S. Government Printing Office. The 
order publication number is 065-000-00588-3. Call 202/783-3238. 1 
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